Nov 05 22:08:43 devstack cinder-volume[76018]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 22:08:43 devstack cinder-volume[76018]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:08:43 devstack cinder-volume[76018]: we strongly recommend against using it for new projects. Nov 05 22:08:43 devstack cinder-volume[76018]: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:08:43 devstack cinder-volume[76018]: framework. For more detail see Nov 05 22:08:43 devstack cinder-volume[76018]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:08:43 devstack cinder-volume[76018]: import eventlet # noqa Nov 05 22:08:46 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:08:46 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:08:46 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:08:47 devstack cinder-volume[76018]: INFO dbcounter [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Registered counter for database cinder Nov 05 22:08:47 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:08:47 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writer thread running {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:08:47 devstack cinder-volume[76018]: INFO cinder.rpc [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 22:08:47 devstack cinder-volume[76018]: INFO cinder.rpc [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 22:08:47 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:08:47 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Determined volume DB was empty at startup. Nov 05 22:08:47 devstack cinder-volume[76018]: DEBUG cinder.volume.manager [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76018) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 22:08:47 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 22:08:47 devstack cinder-volume[76018]: WARNING stevedore.named [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:08:47 devstack cinder-volume[76018]: WARNING castellan.key_manager [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:08:47 devstack cinder-volume[76018]: WARNING cinder.keymgr.conf_key_mgr [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:08:47 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76018) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 22:08:47 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] CMD "cinder-rtstool verify" returned: 0 in 0.467s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:08:48 devstack cinder-volume[76018]: INFO cinder.rpc [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 22:08:48 devstack cinder-volume[76018]: INFO cinder.rpc [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 22:08:48 devstack cinder-volume[76018]: WARNING stevedore.named [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:08:48 devstack cinder-volume[76018]: WARNING castellan.key_manager [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:08:48 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:08:48 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Starting 1 workers Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Started child 76181 {{(pid=76018) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Full set of CONF: {{(pid=76018) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] ******************************************************************************** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Configuration options gathered from: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] ================================================================================ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] allow_availability_zone_fallback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] allow_compression_on_image_upload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] allowed_direct_url_schemes = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] api_rate_limit = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] auth_strategy = keystone {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76181]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] az_cache_duration = 3600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_host = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_stats_polling_interval = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backup_api_class = cinder.backup.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backup_name_template = backup-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backup_use_same_host = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backup_use_temp_snapshot = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] chap_username = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_internal_tenant_project_id = d1557461ff00452bb11343e3b4bbfe75 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_internal_tenant_user_id = 93b4d9831c784c468488051c7c7b8ba5 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cloned_volume_same_az = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cluster = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] compression_format = gzip {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] compute_api_class = cinder.compute.nova.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] config_dir = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] config_source = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] control_exchange = openstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] debug = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] default_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] default_group_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] default_volume_type = lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] driver_ssl_cert_verify = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] driver_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] enable_force_upload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] enable_new_services = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] enable_unsupported_driver = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] enforce_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_api_insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_api_servers = ['http://192.168.122.36/image'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_api_ssl_compression = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_ca_certificates_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_catalog_info = image:glance:publicURL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_num_retries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance_request_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] graceful_shutdown_timeout = 5 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] group_api_class = cinder.group.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] host = devstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_compress_on_upload = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_conversion_address_space_limit = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_conversion_cpu_limit = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76181]: INFO cinder.volume.manager [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_conversion_disable = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_introspection_address_space_limit = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_introspection_cpu_limit = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_upload_use_cinder_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_upload_use_internal_tenant = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_volume_cache_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_volume_cache_max_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] image_volume_cache_max_size_gb = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] init_host_max_objects_retrieval = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] instance_format = [instance: %(uuid)s] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] iscsi_target_flags = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] iscsi_write_cache = on {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] iser_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] iser_ip_address = 192.168.122.36 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] iser_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_color = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_config_append = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_options = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_rotate_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_rotate_interval_type = days {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] log_rotation_type = none {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] max_age = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] max_logfile_count = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] max_logfile_size_mb = 200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] max_over_subscription_ratio = 20.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] message_reap_interval = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] message_ttl = 2592000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] migration_create_volume_timeout_secs = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] monkey_patch = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] monkey_patch_modules = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] my_ip = 192.168.122.36 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] no_snapshot_gb_quota = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] num_iser_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] num_shell_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] num_volume_device_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] nvmeof_conn_info_version = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] nvmet_ns_id = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] nvmet_port_id = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] osapi_max_limit = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] osapi_volume_ext_list = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] osapi_volume_listen_port = 8776 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] osapi_volume_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] osapi_volume_workers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] per_volume_size_limit = -1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] periodic_fuzzy_delay = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] periodic_interval = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] public_endpoint = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] publish_errors = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] quota_backup_gigabytes = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] quota_backups = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] quota_gigabytes = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] quota_groups = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] quota_snapshots = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] quota_volumes = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] rate_limit_burst = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] rate_limit_except_level = CRITICAL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] rate_limit_interval = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] reinit_driver_count = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] report_discard_supported = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] report_interval = 120 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] reservation_clean_interval = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] reservation_expire = 86400 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] reserved_image_namespaces = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] reserved_percentage = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] rpc_response_timeout = 120 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] run_external_periodic_tasks = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] scst_target_driver = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_down_time = 720 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] shell_completion = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] snapshot_name_template = snapshot-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] snapshot_same_host = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] state_path = /opt/stack/data/cinder {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] storage_availability_zone = nova {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] storage_protocol = iSCSI {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] syslog_log_facility = LOG_USER {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] target_helper = lioadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] target_ip_address = 192.168.122.36 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] target_secondary_ip_addresses = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] transport_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] until_refresh = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] use_chap_auth = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] use_default_quota_class = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] use_journal = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] use_json = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] use_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] use_stderr = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] use_syslog = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] verify_glance_signatures = enabled {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_api_class = cinder.volume.api.API {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_clear_size = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_copy_bps_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_dd_blocksize = 1M {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_name_template = volume-%s {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_service_inithost_offload = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volume_usage_audit_period = month {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] zoning_mode = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_concurrency.disable_process_locking = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.auth_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.cache = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.include_service_catalog = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.interface = public {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcache_username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.service_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.36/identity {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.backend = dogpile.cache.null {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.backend_argument = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.backend_expiration_time = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.config_prefix = cache.oslo {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.debug_cache_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.enable_retry_client = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.enable_socket_keepalive = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.expiration_time = 600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.hashclient_retry_attempts = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.memcache_dead_retry = 300 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.memcache_pool_maxsize = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.memcache_sasl_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.proxies = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.redis_db = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.redis_server = localhost:6379 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.retry_attempts = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.retry_delay = 0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.socket_keepalive_count = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.socket_keepalive_idle = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.socket_keepalive_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.socket_timeout = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.tls_allowed_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.tls_cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.tls_certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.tls_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.tls_keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cache.username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] coordination.backend_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.asyncio_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.asyncio_slave_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.backend = sqlalchemy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.connection_debug = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.connection_parameters = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.connection_recycle_time = 3600 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.connection_trace = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.db_inc_retry_interval = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.db_max_retries = 20 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.db_max_retry_interval = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.db_retry_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.max_overflow = 50 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.max_pool_size = 5 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.max_retries = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack sudo[76188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.mysql_wsrep_sync_wait = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack sudo[76188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.pool_timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.retry_interval = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.slave_connection = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.sqlite_synchronous = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.synchronous_reader = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] database.use_db_reconnect = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_tracing.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.connection_string = messaging:// {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.es_doc_type = notification {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.es_scroll_size = 10000 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.es_scroll_time = 2m {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.filter_error_trace = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.hmac_keys = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.sentinel_service_name = mymaster {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.socket_timeout = 0.1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.trace_requests = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler.trace_sqlalchemy = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler_jaeger.process_tags = {} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler_jaeger.service_name_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] profiler_otlp.service_name_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.enforce_new_defaults = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.policy_default_rule = default {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.policy_file = policy.yaml {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] privsep_osbrick.group = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] privsep_osbrick.helper_command = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] privsep_osbrick.user = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_sys_admin.group = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_sys_admin.helper_command = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] cinder_sys_admin.user = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.send_service_user_token = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] service_user.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.auth_type = password {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] glance.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.chap_username = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.driver_use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.extra_capabilities = {} {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.iscsi_target_flags = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.iscsi_write_cache = on {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.iser_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.iser_ip_address = 192.168.122.36 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.iser_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.lvm_share_target = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.lvm_type = auto {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.num_shell_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.report_discard_supported = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.reserved_percentage = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.target_helper = tgtadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.target_ip_address = 192.168.122.36 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.unique_fqdn_network = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.use_chap_auth = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_backend_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_clear_size = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_reports.file_event_handler = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_reports.log_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.backend_host = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.chap_password = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.chap_username = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.disk_geometry = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.driver_client_cert = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.extra_capabilities = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.filter_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.goodness_function = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.iser_helper = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.iser_ip_address = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.iser_port = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.lvm_share_target = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.lvm_type = auto {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.num_shell_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.replication_device = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.report_discard_supported = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.reserved_percentage = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.scst_target_driver = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.storage_protocol = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.target_helper = lioadm {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.target_ip_address = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.target_port = 3260 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.trace_flags = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.use_chap_auth = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_clear = zero {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_clear_size = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] lvmdriver-1.volumes_dir = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_notifications.driver = [] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_notifications.retry = -1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] key_manager.fixed_key = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.barbican_api_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.barbican_endpoint = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.barbican_endpoint_type = public {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.barbican_region_name = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.number_of_retries = 60 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.retry_delay = 1 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.send_service_user_token = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.verify_ssl = True {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican.verify_ssl_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.auth_section = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.auth_type = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.cafile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.certfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.collect_timing = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.insecure = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.keyfile = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.split_loggers = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.timeout = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.tls_ciphers = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] barbican_service_user.tls_min_version = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.approle_role_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.approle_secret_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.auth_method = approle {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.auth_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.kv_mountpoint = secret {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.kv_path = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.kv_version = 2 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.namespace = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.root_token_id = **** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.ssl_ca_crt_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.timeout = 60.0 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.token_file = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.token_role = None {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.use_ssl = False {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:08:48 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] ******************************************************************************** {{(pid=76018) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 22:08:49 devstack sudo[76188]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:49 devstack sudo[76192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:49 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:49 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.331s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:08:49 devstack cinder-volume[76181]: INFO cinder.brick.local_dev.lvm [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:49 devstack sudo[76257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:49 devstack sudo[76257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:49 devstack sudo[76257]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG cinder.brick.local_dev.lvm [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76181) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 22:08:49 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:49 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:49 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:50 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:50 devstack sudo[76554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:50 devstack sudo[76554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:50 devstack sudo[76554]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:50 devstack sudo[76652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 22:08:50 devstack sudo[76652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:50 devstack sudo[76652]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.265s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:50 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:50 devstack sudo[76738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:50 devstack sudo[76738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:51 devstack sudo[76738]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:51 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:51 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:51 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:51 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:51 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:51 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:51 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:51 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:51 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:51 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:52 devstack sudo[76907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:52 devstack sudo[76907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:52 devstack sudo[76907]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:52 devstack cinder-volume[76181]: INFO cinder.volume.drivers.lvm [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:52 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:52 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:52 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG cinder.volume.drivers.lvm [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Updating volume stats {{(pid=76181) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:52 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:52 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:52 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:52 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:52 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:52 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:53 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:53 devstack sudo[77001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:53 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:53 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:53 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:53 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:53 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:53 devstack cinder-volume[76181]: INFO cinder.volume.driver [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Driver hasn't implemented _init_vendor_properties() Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG cinder.volume.driver [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76181) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG oslo_db.sqlalchemy.engines [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG dbcounter [-] [76181] Writer thread running {{(pid=76181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG cinder.db.api [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Building query based on filter {{(pid=76181) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG cinder.image.image_utils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76181) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 22:08:53 devstack cinder-volume[76181]: INFO cinder.keymgr.migration [None req-2925241e-fb9d-4c23-bb17-c612dcd7f302 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG cinder.volume.drivers.lvm [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Updating volume stats {{(pid=76181) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:08:53 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:53 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:53 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:54 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:54 devstack sudo[77010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:54 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:54 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:54 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:54 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:54 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:54 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:54 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:54 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG cinder.manager [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Notifying Schedulers of capabilities ... {{(pid=76181) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:08:54 devstack cinder-volume[76181]: INFO cinder.volume.manager [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Driver initialization completed successfully. Nov 05 22:08:54 devstack cinder-volume[76181]: INFO cinder.manager [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Initiating service 2 cleanup Nov 05 22:08:54 devstack cinder-volume[76181]: INFO cinder.manager [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Service 2 cleanup completed. Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG cinder.service [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Creating RPC server for service cinder-volume {{(pid=76181) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 22:08:54 devstack cinder-volume[76181]: DEBUG cinder.service [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76181) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 22:08:55 devstack cinder-volume[76181]: INFO cinder.volume.manager [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG cinder.volume.drivers.lvm [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Updating volume stats {{(pid=76181) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:55 devstack sudo[77022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:08:55 devstack sudo[77022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:55 devstack sudo[77022]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:55 devstack sudo[77028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:55 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:55 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:55 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:08:55 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:55 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:55 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:08:55 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:08:55 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:08:56 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Nov 05 22:08:56 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:08:56 devstack cinder-volume[76181]: INFO cinder.volume.manager [None req-ecab7120-dcfb-4a43-aa48-1746c65475ed None None] Driver post RPC initialization completed successfully. Nov 05 22:08:58 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:09:06 devstack cinder-volume[76181]: DEBUG dbcounter [-] [76181] Writing DB stats cinder:SELECT=3 {{(pid=76181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:09:06 devstack cinder-volume[76181]: DEBUG dbcounter [-] [76181] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:09:40 devstack cinder-volume[76181]: DEBUG oslo_service.periodic_task [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running periodic task VolumeManager._thread_info {{(pid=76181) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:09:40 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread count: 6 {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:09:40 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread info: [<_MainThread(MainThread, started 135931425628288)>, , , , , ] {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_service.periodic_task [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76181) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG cinder.volume.drivers.lvm [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Updating volume stats {{(pid=76181) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:40 devstack sudo[82160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:10:40 devstack sudo[82160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:40 devstack sudo[82160]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:40 devstack sudo[82163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:10:40 devstack sudo[82163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:40 devstack sudo[82163]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:40 devstack sudo[82166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:10:40 devstack sudo[82166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:40 devstack sudo[82166]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:10:40 devstack sudo[82169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:10:40 devstack sudo[82169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:10:41 devstack sudo[82169]: pam_unix(sudo:session): session closed for user root Nov 05 22:10:41 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:10:41 devstack cinder-volume[76181]: DEBUG cinder.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Notifying Schedulers of capabilities ... {{(pid=76181) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:10:41 devstack cinder-volume[76181]: DEBUG oslo_service.periodic_task [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running periodic task VolumeManager._thread_info {{(pid=76181) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:10:41 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread count: 6 {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:10:41 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread info: [<_MainThread(MainThread, started 135931425628288)>, , , , , ] {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:11:06 devstack cinder-volume[76181]: DEBUG dbcounter [-] [76181] Writing DB stats cinder:SELECT=1 {{(pid=76181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:11:06 devstack cinder-volume[76181]: DEBUG dbcounter [-] [76181] Writing DB stats cinder:UPDATE=1 {{(pid=76181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_service.periodic_task [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76181) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG cinder.volume.drivers.lvm [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Updating volume stats {{(pid=76181) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:40 devstack sudo[84037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:11:40 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:40 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:40 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:11:40 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:40 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:40 devstack sudo[84063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:11:40 devstack sudo[84063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:40 devstack sudo[84063]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:11:40 devstack sudo[84068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:11:40 devstack sudo[84068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:11:41 devstack sudo[84068]: pam_unix(sudo:session): session closed for user root Nov 05 22:11:41 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:11:41 devstack cinder-volume[76181]: DEBUG cinder.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Notifying Schedulers of capabilities ... {{(pid=76181) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:11:41 devstack cinder-volume[76181]: DEBUG oslo_service.periodic_task [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running periodic task VolumeManager._thread_info {{(pid=76181) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:11:41 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread count: 6 {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:11:41 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread info: [<_MainThread(MainThread, started 135931425628288)>, , , , , ] {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_service.periodic_task [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76181) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG cinder.volume.drivers.lvm [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Updating volume stats {{(pid=76181) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:40 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 22:12:40 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:40 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:40 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:12:40 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:40 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:40 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 22:12:40 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:40 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:40 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:12:41 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 22:12:41 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:12:41 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Nov 05 22:12:41 devstack cinder-volume[76181]: DEBUG oslo_concurrency.processutils [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76181) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:12:41 devstack cinder-volume[76181]: DEBUG cinder.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Notifying Schedulers of capabilities ... {{(pid=76181) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:12:41 devstack cinder-volume[76181]: DEBUG oslo_service.periodic_task [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] Running periodic task VolumeManager._thread_info {{(pid=76181) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:12:41 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread count: 6 {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:12:41 devstack cinder-volume[76181]: DEBUG cinder.volume.manager [None req-0d300d77-4afd-40ff-a42b-9b439d4d3945 None None] thread info: [<_MainThread(MainThread, started 135931425628288)>, , , , , ] {{(pid=76181) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:13:06 devstack cinder-volume[76181]: DEBUG dbcounter [-] [76181] Writing DB stats cinder:SELECT=1 {{(pid=76181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:13:06 devstack cinder-volume[76181]: DEBUG dbcounter [-] [76181] Writing DB stats cinder:UPDATE=1 {{(pid=76181) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:13:19 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Caught SIGTERM, stopping children Nov 05 22:13:19 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Acquiring lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:13:19 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Acquired lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:13:19 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Releasing lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:13:19 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Stop services. {{(pid=76018) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 22:13:19 devstack cinder-volume[76018]: DEBUG oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Killing children. {{(pid=76018) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 22:13:19 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Waiting on 1 children to exit Nov 05 22:13:19 devstack cinder-volume[76181]: DEBUG oslo_concurrency.lockutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Acquiring lock "singleton_lock" {{(pid=76181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:13:19 devstack cinder-volume[76181]: DEBUG oslo_concurrency.lockutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Acquired lock "singleton_lock" {{(pid=76181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:13:19 devstack cinder-volume[76181]: DEBUG oslo_concurrency.lockutils [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Releasing lock "singleton_lock" {{(pid=76181) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:13:20 devstack cinder-volume[76181]: WARNING amqp [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:13:20 devstack cinder-volume[76181]: WARNING amqp [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:13:20 devstack cinder-volume[76018]: INFO oslo_service.backend._eventlet.service [None req-eaa69359-cdb8-4f70-b4c9-a2f0c8876d1f None None] Child 76181 exited with status 0 Nov 05 22:13:20 devstack cinder-volume[86212]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 22:13:20 devstack cinder-volume[86212]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:13:20 devstack cinder-volume[86212]: we strongly recommend against using it for new projects. Nov 05 22:13:20 devstack cinder-volume[86212]: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:13:20 devstack cinder-volume[86212]: framework. For more detail see Nov 05 22:13:20 devstack cinder-volume[86212]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:13:20 devstack cinder-volume[86212]: import eventlet # noqa Nov 05 22:13:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:13:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:13:22 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:13:23 devstack cinder-volume[86212]: INFO dbcounter [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Registered counter for database cinder Nov 05 22:13:23 devstack cinder-volume[86212]: DEBUG oslo_db.sqlalchemy.engines [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:23 devstack cinder-volume[86212]: DEBUG dbcounter [-] [86212] Writer thread running {{(pid=86212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:13:23 devstack cinder-volume[86212]: INFO cinder.rpc [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 22:13:23 devstack cinder-volume[86212]: INFO cinder.rpc [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 22:13:23 devstack cinder-volume[86212]: DEBUG oslo_db.sqlalchemy.engines [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Determined volume DB was empty at startup. Nov 05 22:13:23 devstack cinder-volume[86212]: DEBUG cinder.volume.manager [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86212) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 22:13:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 22:13:23 devstack cinder-volume[86212]: WARNING stevedore.named [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:13:23 devstack cinder-volume[86212]: WARNING castellan.key_manager [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:13:23 devstack cinder-volume[86212]: WARNING cinder.keymgr.conf_key_mgr [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:13:23 devstack cinder-volume[86212]: INFO cinder.volume.manager [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_db.sqlalchemy.engines [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:24 devstack cinder-volume[86212]: INFO oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Starting 1 workers Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Started child 86467 {{(pid=86212) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Full set of CONF: {{(pid=86212) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] ******************************************************************************** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Configuration options gathered from: {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] ================================================================================ {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] allow_availability_zone_fallback = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] allow_compression_on_image_upload = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] allowed_direct_url_schemes = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] api_rate_limit = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] auth_strategy = keystone {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_availability_zone = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_host = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_stats_polling_interval = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backup_api_class = cinder.backup.api.API {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backup_name_template = backup-%s {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backup_use_same_host = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backup_use_temp_snapshot = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] chap_password = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] chap_username = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86467]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_internal_tenant_project_id = d1557461ff00452bb11343e3b4bbfe75 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_internal_tenant_user_id = 93b4d9831c784c468488051c7c7b8ba5 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cluster = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] compression_format = gzip {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] compute_api_class = cinder.compute.nova.API {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] config_dir = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] config_source = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] control_exchange = openstack {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] debug = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] default_availability_zone = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] default_group_type = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] default_volume_type = QuobyteHD {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] disk_geometry = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] driver_client_cert = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] driver_client_cert_key = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] driver_data_namespace = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] driver_ssl_cert_path = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] driver_ssl_cert_verify = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] driver_use_ssl = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] enable_new_services = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] enable_unsupported_driver = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] enabled_backends = ['QuobyteHD'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] enforce_multipath_for_image_xfer = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] filter_function = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_api_insecure = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_api_servers = ['http://192.168.122.36/image'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_api_ssl_compression = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_ca_certificates_file = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_catalog_info = image:glance:publicURL {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_num_retries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance_request_timeout = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] goodness_function = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] graceful_shutdown_timeout = 5 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] group_api_class = cinder.group.api.API {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] host = devstack {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_compress_on_upload = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_conversion_address_space_limit = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_conversion_cpu_limit = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_conversion_disable = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_introspection_address_space_limit = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_introspection_cpu_limit = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_upload_use_cinder_backend = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_upload_use_internal_tenant = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_volume_cache_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_volume_cache_max_count = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] image_volume_cache_max_size_gb = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] init_host_max_objects_retrieval = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] instance_format = [instance: %(uuid)s] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] iscsi_target_flags = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] iscsi_write_cache = on {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] iser_helper = tgtadm {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] iser_ip_address = 192.168.122.36 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] iser_port = 3260 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_color = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_config_append = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_dir = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_file = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_options = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_rotate_interval = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_rotate_interval_type = days {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] log_rotation_type = none {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] max_age = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] max_logfile_count = 30 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] max_logfile_size_mb = 200 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] max_over_subscription_ratio = 20.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] message_reap_interval = 86400 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] message_ttl = 2592000 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] migration_create_volume_timeout_secs = 300 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] monkey_patch = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] monkey_patch_modules = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] my_ip = 192.168.122.36 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] no_snapshot_gb_quota = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] num_iser_scan_tries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] num_shell_tries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] num_volume_device_scan_tries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] nvmeof_conn_info_version = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] nvmet_ns_id = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] nvmet_port_id = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] osapi_max_limit = 1000 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] osapi_volume_ext_list = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] osapi_volume_listen_port = 8776 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] osapi_volume_use_ssl = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] osapi_volume_workers = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] per_volume_size_limit = -1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] periodic_fuzzy_delay = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] periodic_interval = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] public_endpoint = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] publish_errors = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] quota_backup_gigabytes = 1000 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] quota_backups = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] quota_gigabytes = 1000 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] quota_groups = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] quota_snapshots = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] quota_volumes = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] rate_limit_burst = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] rate_limit_except_level = CRITICAL {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] rate_limit_interval = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] reinit_driver_count = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] replication_device = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] report_discard_supported = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] report_interval = 120 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] reservation_clean_interval = 86400 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] reservation_expire = 86400 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] reserved_image_namespaces = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] reserved_percentage = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] rpc_response_timeout = 120 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] run_external_periodic_tasks = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] scst_target_driver = iscsi {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] scst_target_iqn_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_down_time = 720 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] shell_completion = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] snapshot_name_template = snapshot-%s {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] split_loggers = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] state_path = /opt/stack/data/cinder {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] storage_availability_zone = nova {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] storage_protocol = iSCSI {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] syslog_log_facility = LOG_USER {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] target_helper = lioadm {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] target_ip_address = 192.168.122.36 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] target_port = 3260 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] target_protocol = iscsi {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] target_secondary_ip_addresses = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] trace_flags = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] transport_url = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] until_refresh = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] use_chap_auth = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] use_default_quota_class = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] use_journal = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] use_json = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] use_multipath_for_image_xfer = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] use_stderr = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] use_syslog = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86467]: INFO cinder.volume.manager [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.remotefs [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86467) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] verify_glance_signatures = enabled {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_api_class = cinder.volume.api.API {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_backend_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_clear = zero {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_clear_ionice = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_clear_size = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_copy_bps_limit = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_dd_blocksize = 1M {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_name_template = volume-%s {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_service_inithost_offload = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volume_usage_audit_period = month {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] zoning_mode = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_concurrency.disable_process_locking = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.auth_section = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.auth_type = password {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.auth_version = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.cache = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.include_service_catalog = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.insecure = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.interface = public {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_password = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcache_username = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.region_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.service_type = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.36/identity {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.backend = dogpile.cache.null {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.backend_argument = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.backend_expiration_time = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.config_prefix = cache.oslo {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.debug_cache_backend = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.enable_retry_client = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.enable_socket_keepalive = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.expiration_time = 600 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.hashclient_retry_attempts = 2 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.memcache_dead_retry = 300 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.memcache_pool_maxsize = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.memcache_sasl_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.password = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.proxies = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.redis_db = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.redis_server = localhost:6379 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.retry_attempts = 2 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.retry_delay = 0.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.socket_keepalive_count = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.socket_keepalive_idle = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.socket_keepalive_interval = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.socket_timeout = 1.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.tls_allowed_ciphers = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.tls_cafile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.tls_certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.tls_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.tls_keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cache.username = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] coordination.backend_url = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.asyncio_connection = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.asyncio_slave_connection = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.backend = sqlalchemy {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.connection = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.connection_debug = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.connection_parameters = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.connection_recycle_time = 3600 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.connection_trace = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.db_inc_retry_interval = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.db_max_retries = 20 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.db_max_retry_interval = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.db_retry_interval = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.max_overflow = 50 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.max_pool_size = 5 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.max_retries = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.mysql_wsrep_sync_wait = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.pool_timeout = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.retry_interval = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.slave_connection = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.sqlite_synchronous = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.synchronous_reader = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] database.use_db_reconnect = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_tracing.insecure = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.connection_string = messaging:// {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.es_doc_type = notification {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.es_scroll_size = 10000 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.es_scroll_time = 2m {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.filter_error_trace = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.hmac_keys = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.sentinel_service_name = mymaster {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.socket_timeout = 0.1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.trace_requests = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler.trace_sqlalchemy = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler_jaeger.process_tags = {} {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler_jaeger.service_name_prefix = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] profiler_otlp.service_name_prefix = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.enforce_new_defaults = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.policy_default_rule = default {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.policy_file = policy.yaml {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] privsep_osbrick.group = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] privsep_osbrick.helper_command = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] privsep_osbrick.user = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_sys_admin.group = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_sys_admin.helper_command = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] cinder_sys_admin.user = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.auth_section = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.auth_type = password {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.cafile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.collect_timing = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.insecure = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.send_service_user_token = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.split_loggers = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.timeout = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.tls_ciphers = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] service_user.tls_min_version = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.auth_section = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.auth_type = password {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.collect_timing = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.insecure = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.region_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.split_loggers = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.timeout = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.tls_ciphers = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] glance.tls_min_version = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.backend_availability_zone = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.chap_password = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.chap_username = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.disk_geometry = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.driver_client_cert = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.driver_client_cert_key = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.driver_data_namespace = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.driver_use_ssl = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.extra_capabilities = {} {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.filter_function = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.goodness_function = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.iscsi_target_flags = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.iscsi_write_cache = on {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.iser_helper = tgtadm {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.iser_ip_address = 192.168.122.36 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.iser_port = 3260 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_host = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_login = admin {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_mount_options = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_password = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_private_key = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_share_path = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.num_shell_tries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.quobyte_volume_url = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.replication_device = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.report_discard_supported = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.reserved_percentage = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.target_helper = tgtadm {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.target_ip_address = 192.168.122.36 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.target_port = 3260 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.target_protocol = iscsi {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.trace_flags = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.unique_fqdn_network = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.use_chap_auth = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_backend_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_clear = zero {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_clear_ionice = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_clear_size = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_reports.file_event_handler = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_reports.log_dir = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.backend_availability_zone = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.backend_host = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.chap_password = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.chap_username = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.chiscsi_conf = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.disk_geometry = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.driver_client_cert = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.driver_data_namespace = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.driver_use_ssl = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.extra_capabilities = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.filter_function = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.goodness_function = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.iser_helper = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.iser_ip_address = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.iser_port = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.iser_target_prefix = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_host = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_login = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_mount_options = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_password = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_private_key = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_share_path = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_ssh_port = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.num_shell_tries = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.nvmet_port_id = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.replication_device = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.report_discard_supported = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.reserved_percentage = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.scst_target_driver = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.storage_protocol = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.target_helper = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.target_ip_address = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.target_port = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.target_prefix = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.target_protocol = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.trace_flags = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.use_chap_auth = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_clear = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_clear_size = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] QuobyteHD.volumes_dir = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.ssl = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86467) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_notifications.driver = [] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_notifications.retry = -1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86467]: WARNING cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86467]: WARNING cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] key_manager.fixed_key = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Running cmd (subprocess): mount.quobyte {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.barbican_api_version = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.barbican_endpoint = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.barbican_endpoint_type = public {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.barbican_region_name = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.cafile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.collect_timing = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.insecure = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.number_of_retries = 60 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.retry_delay = 1 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.send_service_user_token = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.split_loggers = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.timeout = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.tls_ciphers = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.tls_min_version = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.verify_ssl = True {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican.verify_ssl_path = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.auth_section = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.auth_type = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.cafile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.certfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.collect_timing = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.insecure = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.keyfile = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.split_loggers = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.timeout = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.tls_ciphers = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] barbican_service_user.tls_min_version = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.approle_role_id = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.approle_secret_id = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.auth_method = approle {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.auth_path = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.kv_mountpoint = secret {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.kv_path = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.kv_version = 2 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.namespace = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.root_token_id = **** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.ssl_ca_crt_file = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.timeout = 60.0 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.token_file = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.token_role = None {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.use_ssl = False {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:24 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] ******************************************************************************** {{(pid=86212) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 22:13:24 devstack quobyte-client[86472]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 22:13:24 devstack quobyte-client[86472]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=86467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:24 devstack cinder-volume[86467]: INFO cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 ... Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 -c /etc/quobyte/client-cinder.cfg {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:24 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 -c /etc/quobyte/client-cinder.cfg Nov 05 22:13:24 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:24 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.425s {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:24 devstack cinder-volume[86467]: INFO cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 succeeded Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=86467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.440s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:24 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:24 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:13:24 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:25 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.239s {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:25 devstack cinder-volume[86467]: INFO cinder.volume.driver [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Driver hasn't implemented _init_vendor_properties() Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.volume.driver [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.420322418213, 'free_capacity_gb': 1773.420322418213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86467) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_db.sqlalchemy.engines [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86467) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG dbcounter [-] [86467] Writer thread running {{(pid=86467) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.db.api [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Building query based on filter {{(pid=86467) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.image.image_utils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86467) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 22:13:25 devstack cinder-volume[86467]: INFO cinder.keymgr.migration [None req-5c187bb3-3d05-4011-b0f5-7ebee83d6181 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=86467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=86467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:25 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:13:25 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:25 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.239s {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.manager [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Notifying Schedulers of capabilities ... {{(pid=86467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:13:25 devstack cinder-volume[86467]: INFO cinder.volume.manager [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Driver initialization completed successfully. Nov 05 22:13:25 devstack cinder-volume[86467]: INFO cinder.manager [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Initiating service 3 cleanup Nov 05 22:13:25 devstack cinder-volume[86467]: INFO cinder.manager [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Service 3 cleanup completed. Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.service [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Creating RPC server for service cinder-volume {{(pid=86467) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.service [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86467) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 22:13:25 devstack cinder-volume[86467]: INFO cinder.volume.manager [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=86467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=86467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:25 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:13:25 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:25 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:25 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.281s {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:25 devstack cinder-volume[86467]: INFO cinder.volume.manager [None req-29e16707-2d3c-4e57-b113-f17d1a52f01d None None] Driver post RPC initialization completed successfully. Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=86467) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG cinder.volume.drivers.quobyte [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=86467) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86467) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:30 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:13:30 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:30 devstack cinder-volume[86212]: INFO oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Caught SIGTERM, stopping children Nov 05 22:13:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Acquiring lock "singleton_lock" {{(pid=86212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:13:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Acquired lock "singleton_lock" {{(pid=86212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:13:30 devstack cinder-volume[86212]: DEBUG oslo_concurrency.lockutils [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Releasing lock "singleton_lock" {{(pid=86212) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:13:30 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Stop services. {{(pid=86212) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 22:13:30 devstack cinder-volume[86212]: DEBUG oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Killing children. {{(pid=86212) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 22:13:30 devstack cinder-volume[86212]: INFO oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Waiting on 1 children to exit Nov 05 22:13:30 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG oslo_concurrency.processutils [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.254s {{(pid=86467) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:30 devstack cinder-volume[86467]: DEBUG cinder.manager [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Notifying Schedulers of capabilities ... {{(pid=86467) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo.messaging._drivers.impl_rabbit [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo.messaging._drivers.impl_rabbit [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Unable to connect to AMQP server on 192.168.122.36:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server [None req-379eb47a-cc68-4beb-9a29-1662dd240568 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.36:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server method() Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return _publish( Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server listener(*args) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.36:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 05 22:13:30 devstack cinder-volume[86467]: ERROR oslo_messaging.rpc.server Nov 05 22:13:33 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Acquiring lock "singleton_lock" {{(pid=86467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:13:33 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Acquired lock "singleton_lock" {{(pid=86467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:13:33 devstack cinder-volume[86467]: DEBUG oslo_concurrency.lockutils [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Releasing lock "singleton_lock" {{(pid=86467) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:13:33 devstack cinder-volume[86467]: WARNING amqp [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:13:33 devstack cinder-volume[86467]: WARNING amqp [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 22:13:33 devstack cinder-volume[86212]: INFO oslo_service.backend._eventlet.service [None req-64d4ee72-2304-482c-8409-dca53e168125 None None] Child 86467 exited with status 0 Nov 05 22:13:34 devstack cinder-volume[86787]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 22:13:34 devstack cinder-volume[86787]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:13:34 devstack cinder-volume[86787]: we strongly recommend against using it for new projects. Nov 05 22:13:34 devstack cinder-volume[86787]: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:13:34 devstack cinder-volume[86787]: framework. For more detail see Nov 05 22:13:34 devstack cinder-volume[86787]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:13:34 devstack cinder-volume[86787]: import eventlet # noqa Nov 05 22:13:37 devstack cinder-volume[86787]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86787) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 22:13:37 devstack cinder-volume[86787]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86787) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 22:13:37 devstack cinder-volume[86787]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86787) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 22:13:38 devstack cinder-volume[86787]: INFO dbcounter [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Registered counter for database cinder Nov 05 22:13:38 devstack cinder-volume[86787]: DEBUG oslo_db.sqlalchemy.engines [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86787) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:38 devstack cinder-volume[86787]: DEBUG dbcounter [-] [86787] Writer thread running {{(pid=86787) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:13:38 devstack cinder-volume[86787]: INFO cinder.rpc [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 22:13:38 devstack cinder-volume[86787]: INFO cinder.rpc [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 22:13:38 devstack cinder-volume[86787]: DEBUG oslo_db.sqlalchemy.engines [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86787) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:38 devstack cinder-volume[86787]: INFO cinder.volume.manager [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Determined volume DB was empty at startup. Nov 05 22:13:38 devstack cinder-volume[86787]: DEBUG cinder.volume.manager [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86787) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 22:13:38 devstack cinder-volume[86787]: WARNING stevedore.named [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 22:13:38 devstack cinder-volume[86787]: WARNING castellan.key_manager [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:13:38 devstack cinder-volume[86787]: WARNING cinder.keymgr.conf_key_mgr [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 22:13:38 devstack cinder-volume[86787]: INFO cinder.volume.manager [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_db.sqlalchemy.engines [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86787) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:39 devstack cinder-volume[86787]: INFO oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Starting 1 workers Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Started child 87085 {{(pid=86787) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Full set of CONF: {{(pid=86787) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] ******************************************************************************** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] Configuration options gathered from: {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] ================================================================================ {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] allow_availability_zone_fallback = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] allow_compression_on_image_upload = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] allowed_direct_url_schemes = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] api_rate_limit = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] auth_strategy = keystone {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_availability_zone = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_host = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_stats_polling_interval = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backup_api_class = cinder.backup.api.API {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backup_name_template = backup-%s {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backup_use_same_host = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backup_use_temp_snapshot = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] chap_password = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] chap_username = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_internal_tenant_project_id = d1557461ff00452bb11343e3b4bbfe75 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_internal_tenant_user_id = 93b4d9831c784c468488051c7c7b8ba5 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cluster = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] compression_format = gzip {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] config_dir = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] config_source = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] control_exchange = openstack {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] debug = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] default_availability_zone = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] default_group_type = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] default_volume_type = QuobyteHD {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] disk_geometry = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] driver_client_cert = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] driver_client_cert_key = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] driver_data_namespace = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] driver_ssl_cert_path = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] driver_ssl_cert_verify = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] driver_use_ssl = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] enable_new_services = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] enable_unsupported_driver = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] enforce_multipath_for_image_xfer = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] filter_function = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_api_insecure = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_api_servers = ['http://192.168.122.36/image'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_api_ssl_compression = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_ca_certificates_file = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_num_retries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance_request_timeout = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] goodness_function = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] graceful_shutdown_timeout = 5 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] group_api_class = cinder.group.api.API {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] host = devstack {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_compress_on_upload = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_conversion_address_space_limit = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_conversion_cpu_limit = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_conversion_disable = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_introspection_address_space_limit = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_introspection_cpu_limit = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_upload_use_cinder_backend = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_upload_use_internal_tenant = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_volume_cache_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_volume_cache_max_count = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] init_host_max_objects_retrieval = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] instance_format = [instance: %(uuid)s] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] iscsi_target_flags = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] iscsi_write_cache = on {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] iser_helper = tgtadm {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] iser_ip_address = 192.168.122.36 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] iser_port = 3260 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_color = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_config_append = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_dir = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_file = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_options = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_rotate_interval = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_rotate_interval_type = days {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] log_rotation_type = none {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] max_age = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] max_logfile_count = 30 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] max_logfile_size_mb = 200 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] max_over_subscription_ratio = 20.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] message_reap_interval = 86400 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87085) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] message_ttl = 2592000 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] monkey_patch = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] monkey_patch_modules = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] my_ip = 192.168.122.36 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] no_snapshot_gb_quota = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] num_iser_scan_tries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] num_shell_tries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] num_volume_device_scan_tries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] nvmeof_conn_info_version = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] nvmet_ns_id = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] nvmet_port_id = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] osapi_max_limit = 1000 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] osapi_volume_ext_list = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] osapi_volume_listen_port = 8776 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] osapi_volume_use_ssl = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] osapi_volume_workers = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] per_volume_size_limit = -1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] periodic_fuzzy_delay = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] periodic_interval = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] public_endpoint = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] publish_errors = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] quota_backup_gigabytes = 1000 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] quota_backups = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] quota_gigabytes = 1000 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] quota_groups = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] quota_snapshots = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] quota_volumes = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] rate_limit_burst = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] rate_limit_except_level = CRITICAL {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] rate_limit_interval = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] reinit_driver_count = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] replication_device = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] report_discard_supported = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] report_interval = 120 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] reservation_clean_interval = 86400 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] reservation_expire = 86400 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] reserved_image_namespaces = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] reserved_percentage = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] rpc_response_timeout = 120 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] run_external_periodic_tasks = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] scst_target_driver = iscsi {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] scst_target_iqn_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_down_time = 720 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] shell_completion = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] snapshot_name_template = snapshot-%s {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] split_loggers = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] state_path = /opt/stack/data/cinder {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] storage_availability_zone = nova {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] storage_protocol = iSCSI {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] syslog_log_facility = LOG_USER {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] target_helper = lioadm {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] target_ip_address = 192.168.122.36 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] target_port = 3260 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] target_protocol = iscsi {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] target_secondary_ip_addresses = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] trace_flags = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] transport_url = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] until_refresh = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] use_chap_auth = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] use_default_quota_class = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] use_journal = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] use_json = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] use_multipath_for_image_xfer = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] use_stderr = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] use_syslog = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] verify_glance_signatures = enabled {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_api_class = cinder.volume.api.API {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_backend_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_clear = zero {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_clear_ionice = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_clear_size = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_copy_bps_limit = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_dd_blocksize = 1M {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_name_template = volume-%s {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_service_inithost_offload = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volume_usage_audit_period = month {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] zoning_mode = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.auth_section = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.auth_type = password {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.auth_version = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.cache = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.insecure = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.interface = public {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_password = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcache_username = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.region_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.service_type = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.36/identity {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.backend = dogpile.cache.null {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.backend_argument = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.backend_expiration_time = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.config_prefix = cache.oslo {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.debug_cache_backend = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.enable_retry_client = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.enable_socket_keepalive = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.expiration_time = 600 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.memcache_dead_retry = 300 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.memcache_sasl_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87085) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.password = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.proxies = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.redis_db = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.redis_server = localhost:6379 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.retry_attempts = 2 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.retry_delay = 0.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.socket_keepalive_count = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.socket_keepalive_idle = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Running cmd (subprocess): mount.quobyte {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.socket_keepalive_interval = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.socket_timeout = 1.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.tls_allowed_ciphers = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.tls_cafile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.tls_certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.tls_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.tls_keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cache.username = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] coordination.backend_url = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.asyncio_connection = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.asyncio_slave_connection = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.backend = sqlalchemy {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.connection = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.connection_debug = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.connection_parameters = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.connection_recycle_time = 3600 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.connection_trace = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.db_inc_retry_interval = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.db_max_retries = 20 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.db_max_retry_interval = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.db_retry_interval = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.max_overflow = 50 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.max_pool_size = 5 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.max_retries = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.pool_timeout = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.retry_interval = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.slave_connection = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.sqlite_synchronous = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.synchronous_reader = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] database.use_db_reconnect = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_tracing.insecure = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.connection_string = messaging:// {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.es_doc_type = notification {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.es_scroll_size = 10000 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.es_scroll_time = 2m {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.filter_error_trace = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.hmac_keys = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.sentinel_service_name = mymaster {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.socket_timeout = 0.1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.trace_requests = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler.trace_sqlalchemy = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler_jaeger.process_tags = {} {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] profiler_otlp.service_name_prefix = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.policy_default_rule = default {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] privsep_osbrick.group = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] privsep_osbrick.helper_command = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] privsep_osbrick.user = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_sys_admin.group = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_sys_admin.helper_command = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] cinder_sys_admin.user = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.auth_section = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.auth_type = password {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.cafile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.collect_timing = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.insecure = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.send_service_user_token = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.split_loggers = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.timeout = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.tls_ciphers = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] service_user.tls_min_version = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.auth_section = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.auth_type = password {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.collect_timing = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.insecure = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.region_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.split_loggers = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.timeout = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.tls_ciphers = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] glance.tls_min_version = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.backend_availability_zone = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.chap_password = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.chap_username = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.disk_geometry = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.driver_client_cert = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.driver_data_namespace = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.driver_use_ssl = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.extra_capabilities = {} {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.filter_function = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.goodness_function = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.iscsi_target_flags = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.iser_ip_address = 192.168.122.36 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.iser_port = 3260 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_host = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_login = admin {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_mount_options = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_password = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_private_key = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_share_path = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack quobyte-client[87086]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack quobyte-client[87086]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.replication_device = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.report_discard_supported = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.target_helper = tgtadm {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.target_ip_address = 192.168.122.36 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.target_port = 3260 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.target_protocol = iscsi {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.trace_flags = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.use_chap_auth = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_backend_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_clear = zero {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_reports.file_event_handler = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_reports.log_dir = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.backend_host = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.chap_password = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.chap_username = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.disk_geometry = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.driver_client_cert = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.extra_capabilities = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.filter_function = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.goodness_function = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.iser_helper = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.iser_ip_address = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.iser_port = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_host = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_login = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_mount_options = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_password = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_private_key = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_share_path = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.num_shell_tries = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.replication_device = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.report_discard_supported = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.reserved_percentage = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.scst_target_driver = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.storage_protocol = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.target_helper = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.target_ip_address = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.target_port = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.target_prefix = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.target_protocol = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.trace_flags = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.use_chap_auth = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_clear = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_clear_size = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] QuobyteHD.volumes_dir = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_notifications.driver = [] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] key_manager.fixed_key = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.barbican_api_version = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.barbican_endpoint = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.barbican_endpoint_type = public {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.barbican_region_name = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.cafile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.collect_timing = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.insecure = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.number_of_retries = 60 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.retry_delay = 1 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.send_service_user_token = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.split_loggers = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.timeout = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.tls_ciphers = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.tls_min_version = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.verify_ssl = True {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican.verify_ssl_path = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.auth_section = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.auth_type = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.cafile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.certfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.collect_timing = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.insecure = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.keyfile = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.split_loggers = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.timeout = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.tls_ciphers = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] barbican_service_user.tls_min_version = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.approle_role_id = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.approle_secret_id = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.auth_method = approle {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.auth_path = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.kv_mountpoint = secret {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.kv_path = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.kv_version = 2 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.namespace = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.root_token_id = **** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.ssl_ca_crt_file = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.timeout = 60.0 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.token_file = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.token_role = None {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.use_ssl = False {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 22:13:39 devstack cinder-volume[86787]: DEBUG oslo_service.backend._eventlet.service [None req-9d5dd0a8-dfb3-4c4e-962c-080b854a2bb8 None None] ******************************************************************************** {{(pid=86787) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 22:13:39 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.264s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.volume.driver [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.driver [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.420322418213, 'free_capacity_gb': 1773.420322418213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87085) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_db.sqlalchemy.engines [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87085) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writer thread running {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.db.api [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Building query based on filter {{(pid=87085) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87085) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.keymgr.migration [None req-2c9989e4-b4f7-4949-928e-101ac428ba24 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 22:13:39 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:13:39 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:39 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.241s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Driver initialization completed successfully. Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.manager [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Initiating service 3 cleanup Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.manager [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Service 3 cleanup completed. Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.service [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Creating RPC server for service cinder-volume {{(pid=87085) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.service [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87085) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 22:13:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:13:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:13:40 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:13:40 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:13:40 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Nov 05 22:13:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.242s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:13:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-84d17eab-3baa-4a62-ba33-7a23586a18c4 None None] Driver post RPC initialization completed successfully. Nov 05 22:13:49 devstack cinder-volume[86787]: DEBUG dbcounter [-] [86787] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86787) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:13:49 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:13:50 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=4 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:14:38 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:14:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Flow 'volume_create_manager' (9909137e-bbf8-4704-8a16-59bad62d7f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44156b86-591e-4b0a-891f-b70e71278465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44156b86-591e-4b0a-891f-b70e71278465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2023489781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed10c764-a683-4a7b-beae-c68766e48f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414f11f33a344483931650403925b486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:39Z,use_quota=True,user_id='65f7243c418b4958a710b6f087fae2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bfb73c-8f87-4b8f-a643-cfa02d58e402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bfb73c-8f87-4b8f-a643-cfa02d58e402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b70cd0-1f2e-45db-a6b1-65c9ebd1cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b70cd0-1f2e-45db-a6b1-65c9ebd1cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed10c764-a683-4a7b-beae-c68766e48f4c', 'volume_name': 'volume-ed10c764-a683-4a7b-beae-c68766e48f4c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223a81a0-a739-485b-bdce-d1e9d3425b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223a81a0-a739-485b-bdce-d1e9d3425b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530d34d-24be-4918-ba52-fa04fb8914ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:39 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Volume ed10c764-a683-4a7b-beae-c68766e48f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed10c764-a683-4a7b-beae-c68766e48f4c', 'volume_size': 1} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2023489781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed10c764-a683-4a7b-beae-c68766e48f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414f11f33a344483931650403925b486',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:14:39Z,use_quota=True,user_id='65f7243c418b4958a710b6f087fae2c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Creating volume ed10c764-a683-4a7b-beae-c68766e48f4c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:14:39 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:14:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:39 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c 1073741824 Nov 05 22:14:39 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:40 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:14:40 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:40 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c 1073741824" returned: 0 in 1.263s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:14:40 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c Nov 05 22:14:40 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:14:40 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.617s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 6 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:14:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:14:41 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Nov 05 22:14:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c" returned: 0 in 0.570s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:14:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:14:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:14:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530d34d-24be-4918-ba52-fa04fb8914ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed10c764-a683-4a7b-beae-c68766e48f4c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929d8a9e-2d20-4d5c-89c0-49ef2d465c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:14:41 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Volume volume-ed10c764-a683-4a7b-beae-c68766e48f4c (ed10c764-a683-4a7b-beae-c68766e48f4c): created successfully Nov 05 22:14:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929d8a9e-2d20-4d5c-89c0-49ef2d465c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:14:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Flow 'volume_create_manager' (9909137e-bbf8-4704-8a16-59bad62d7f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:14:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c9e1ca67-0f69-466a-b51f-ded16401ae0a tempest-TaggedAttachmentsTest-1885649051 None] Created volume successfully. Nov 05 22:14:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:14:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Flow 'volume_create_manager' (c6d948d4-800c-425a-a3b0-57c09325fcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74318d6e-b844-4644-80fa-6397a2d2afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74318d6e-b844-4644-80fa-6397a2d2afa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-725793119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8434e8-c42d-4295-819f-b3b2dcd5e776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17f08e1375c4274b361bd477f8ea45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:06Z,use_quota=True,user_id='33c70bd41a94411ca319dff97bb8a9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a080ea2a-500a-40fa-8109-baf6b8143265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a080ea2a-500a-40fa-8109-baf6b8143265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab55b239-4067-4ae9-b239-02d5bc45a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab55b239-4067-4ae9-b239-02d5bc45a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8434e8-c42d-4295-819f-b3b2dcd5e776', 'volume_name': 'volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41276a1-7acc-4fcb-b3ea-9bfab0609864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41276a1-7acc-4fcb-b3ea-9bfab0609864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc3bd88-5ced-4cdc-97da-759f686f7c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:06 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Volume 4e8434e8-c42d-4295-819f-b3b2dcd5e776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776', 'volume_size': 1} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-725793119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8434e8-c42d-4295-819f-b3b2dcd5e776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17f08e1375c4274b361bd477f8ea45e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:06Z,use_quota=True,user_id='33c70bd41a94411ca319dff97bb8a9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Creating volume 4e8434e8-c42d-4295-819f-b3b2dcd5e776 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:06 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:15:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:06 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 1073741824 Nov 05 22:15:06 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:07 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 1073741824" returned: 0 in 1.270s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:07 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 Nov 05 22:15:07 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:08 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776" returned: 0 in 0.724s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc3bd88-5ced-4cdc-97da-759f686f7c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7719c44-7bc9-4d26-b3aa-e1e8d16a1531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:08 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Volume volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 (4e8434e8-c42d-4295-819f-b3b2dcd5e776): created successfully Nov 05 22:15:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7719c44-7bc9-4d26-b3aa-e1e8d16a1531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Flow 'volume_create_manager' (c6d948d4-800c-425a-a3b0-57c09325fcbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a79896f3-986d-45dc-a545-68f3daa3b918 tempest-ServerRescueNegativeTestJSON-1655831365 None] Created volume successfully. Nov 05 22:15:18 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:15:18 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:15:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Acquiring lock "cinder-4e8434e8-c42d-4295-819f-b3b2dcd5e776-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "cinder-4e8434e8-c42d-4295-819f-b3b2dcd5e776-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Acquiring lock "cinder-quobyte-4e8434e8-c42d-4295-819f-b3b2dcd5e776" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "cinder-quobyte-4e8434e8-c42d-4295-819f-b3b2dcd5e776" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:21 devstack cinder-volume[87085]: INFO oslo.privsep.daemon [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfz8uj4e_/privsep.sock'] Nov 05 22:15:21 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfz8uj4e_/privsep.sock Nov 05 22:15:21 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 22:15:22 devstack cinder-volume[87085]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 22:15:23 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:23 devstack cinder-volume[87085]: INFO oslo.privsep.daemon [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Spawned new privsep daemon via rootwrap Nov 05 22:15:23 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Accepted privsep connection to /tmp/tmpfz8uj4e_/privsep.sock {{(pid=87085) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 22:15:23 devstack cinder-volume[87085]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 22:15:23 devstack cinder-volume[87085]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 22:15:23 devstack cinder-volume[87085]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 22:15:23 devstack cinder-volume[87085]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88570 Nov 05 22:15:23 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d4251c-0aa2-432a-b530-3b4237df6314]: (2,) {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:23 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17a346-bd30-4e08-bb5d-ac333cab659e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:24 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 Nov 05 22:15:24 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Flow 'volume_create_manager' (296a9646-c851-4e0d-a61d-2710cd12e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e42a534-ce45-4422-bad8-743b79b54506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e42a534-ce45-4422-bad8-743b79b54506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-251120938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47064b54-17a0-4206-a993-d5c814a7c95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfc19086e3e41d1a3665f4cf7dcd742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:24Z,use_quota=True,user_id='12440dde80cd4309b35e7581956f813a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87139aa9-95a3-42e8-912e-76c9804ec656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87139aa9-95a3-42e8-912e-76c9804ec656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f98cc5-17f5-473e-ac78-084cac221416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f98cc5-17f5-473e-ac78-084cac221416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47064b54-17a0-4206-a993-d5c814a7c95c', 'volume_name': 'volume-47064b54-17a0-4206-a993-d5c814a7c95c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6452b0-7caf-4954-9d51-46510f29a6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6452b0-7caf-4954-9d51-46510f29a6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2338d86d-b2f4-4c7b-9a06-19ed6cf0493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:24 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Volume 47064b54-17a0-4206-a993-d5c814a7c95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47064b54-17a0-4206-a993-d5c814a7c95c', 'volume_size': 1} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-251120938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47064b54-17a0-4206-a993-d5c814a7c95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dfc19086e3e41d1a3665f4cf7dcd742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:24Z,use_quota=True,user_id='12440dde80cd4309b35e7581956f813a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Creating volume 47064b54-17a0-4206-a993-d5c814a7c95c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:24 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:24 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c 1073741824 Nov 05 22:15:24 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:24 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776" returned: 0 in 0.956s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:24 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776 Nov 05 22:15:24 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:25 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e8434e8-c42d-4295-819f-b3b2dcd5e776" returned: 0 in 0.670s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:25 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c 1073741824" returned: 0 in 1.191s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "cinder-quobyte-4e8434e8-c42d-4295-819f-b3b2dcd5e776" released by "delete_volume" :: held 3.750s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:25 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c Nov 05 22:15:25 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:25 devstack cinder-volume[87085]: WARNING cinder.quota [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:15:25 devstack cinder-volume[87085]: WARNING cinder.quota [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Created reservations ['6a325d98-8e50-46df-a301-a0d1b9f004e7', 'a84c3a39-bc5c-4fba-a896-5cb271ff3d87', 'db42bc4b-e90a-4691-9c1c-8e2f9919788d', 'b8ef8234-6439-4401-85bb-a8d568b93d52'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:25 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:15:25 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:26 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c" returned: 0 in 0.470s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2338d86d-b2f4-4c7b-9a06-19ed6cf0493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47064b54-17a0-4206-a993-d5c814a7c95c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07bbaa7-c45b-4fd1-9b39-7d5930f0b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:26 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Volume volume-47064b54-17a0-4206-a993-d5c814a7c95c (47064b54-17a0-4206-a993-d5c814a7c95c): created successfully Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07bbaa7-c45b-4fd1-9b39-7d5930f0b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Flow 'volume_create_manager' (296a9646-c851-4e0d-a61d-2710cd12e606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-155e665f-acce-4a2e-922d-a74775200011 tempest-AttachVolumeShelveTestJSON-745836297 None] Created volume successfully. Nov 05 22:15:26 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Deleted volume successfully. Nov 05 22:15:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-813c4129-e0d2-4282-967a-9db20170160a tempest-ServerRescueNegativeTestJSON-1655831365 None] Lock "cinder-4e8434e8-c42d-4295-819f-b3b2dcd5e776-delete_volume" released by "delete_volume" :: held 4.689s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:15:36 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:15:36 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=13,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:40 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:15:40 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:40 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.402s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:15:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1a7ca9a5-a16b-4f03-b446-6dd781f5c7a8 tempest-GroupSnapshotsTest-1595597801 None] Group tempest-GroupSnapshotsTest-Group-311371902: creating Nov 05 22:15:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1a7ca9a5-a16b-4f03-b446-6dd781f5c7a8 tempest-GroupSnapshotsTest-1595597801 None] Group tempest-GroupSnapshotsTest-Group-311371902: created successfully Nov 05 22:15:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1a7ca9a5-a16b-4f03-b446-6dd781f5c7a8 tempest-GroupSnapshotsTest-1595597801 None] Create group completed successfully. Nov 05 22:15:47 devstack cinder-volume[87085]: WARNING py.warnings [req-4ca32680-2bd2-4b75-af1e-f123f5715169 req-6764cce3-a138-421c-a980-ea0eb50546a6 tempest-AttachVolumeShelveTestJSON-745836297 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 05 22:15:47 devstack cinder-volume[87085]: .first() Nov 05 22:15:47 devstack cinder-volume[87085]: Nov 05 22:15:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-4ca32680-2bd2-4b75-af1e-f123f5715169 req-6764cce3-a138-421c-a980-ea0eb50546a6 tempest-AttachVolumeShelveTestJSON-745836297 None] No connector for attachment dd2364f9-e515-4d33-b1d3-3d2339f367bf; skipping storage backend terminate_connection call. {{(pid=87085) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 05 22:15:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-4ca32680-2bd2-4b75-af1e-f123f5715169 req-6764cce3-a138-421c-a980-ea0eb50546a6 tempest-AttachVolumeShelveTestJSON-745836297 None] Deleting attachment dd2364f9-e515-4d33-b1d3-3d2339f367bf. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (6050c369-3327-49c2-b190-28261f62ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf058e74-8f89-42d7-a17f-ae4a704f81ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf058e74-8f89-42d7-a17f-ae4a704f81ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36903834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6eea00e3-5320-44d1-918c-f8665c851b6d,host='devstack@QuobyteHD#QuobyteHD',id=9afa32ea-e51d-4318-a2c5-a41f0123bc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:49Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc8d2b0-9666-4c20-89be-f446a192098a),volume_type_id=8cc8d2b0-9666-4c20-89be-f446a192098a)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd242150-d420-4285-a89e-899d2d54ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd242150-d420-4285-a89e-899d2d54ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252266b5-d541-4dfa-8729-62ee44993545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252266b5-d541-4dfa-8729-62ee44993545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9afa32ea-e51d-4318-a2c5-a41f0123bc0e', 'volume_name': 'volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac93a56-a9f7-4822-87d8-4438667421cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac93a56-a9f7-4822-87d8-4438667421cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702faf23-de70-4478-96f4-34cbed7a7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Volume 9afa32ea-e51d-4318-a2c5-a41f0123bc0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e', 'volume_size': 1} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6eea00e3-5320-44d1-918c-f8665c851b6d,created_at=2026-11-05T21:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36903834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6eea00e3-5320-44d1-918c-f8665c851b6d,host='devstack@QuobyteHD#QuobyteHD',id=9afa32ea-e51d-4318-a2c5-a41f0123bc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:15:49Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cc8d2b0-9666-4c20-89be-f446a192098a),volume_type_id=8cc8d2b0-9666-4c20-89be-f446a192098a)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Creating volume 9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:49 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:15:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:49 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e 1073741824 Nov 05 22:15:49 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:50 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e 1073741824" returned: 0 in 0.595s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:50 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e Nov 05 22:15:50 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-dfb50941-98f2-4553-9155-82efe31d9209 req-0de36133-80e0-41b3-b817-4d1b880f3f4c tempest-TaggedAttachmentsTest-1885649051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:50 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" returned: 0 in 0.338s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-dfb50941-98f2-4553-9155-82efe31d9209 req-0de36133-80e0-41b3-b817-4d1b880f3f4c tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.204s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702faf23-de70-4478-96f4-34cbed7a7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b761732e-966a-4119-9586-41c0c718a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-dfb50941-98f2-4553-9155-82efe31d9209 req-0de36133-80e0-41b3-b817-4d1b880f3f4c tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:50 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Volume volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e (9afa32ea-e51d-4318-a2c5-a41f0123bc0e): created successfully Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b761732e-966a-4119-9586-41c0c718a253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (6050c369-3327-49c2-b190-28261f62ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:15:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8e98af5a-adaa-473b-9840-a14e93c8f0c3 tempest-GroupSnapshotsTest-1595597801 None] Created volume successfully. Nov 05 22:15:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-dfb50941-98f2-4553-9155-82efe31d9209 req-0de36133-80e0-41b3-b817-4d1b880f3f4c tempest-TaggedAttachmentsTest-1885649051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-ed10c764-a683-4a7b-beae-c68766e48f4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ade1b638-1671-4b79-86d8-fcc5ef388c45', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:15:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-dfb50941-98f2-4553-9155-82efe31d9209 req-0de36133-80e0-41b3-b817-4d1b880f3f4c tempest-TaggedAttachmentsTest-1885649051 None] attachment_update completed successfully. Nov 05 22:15:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] GroupSnapshot 4381024d-2948-4e74-b50b-9ef918735093: creating. Nov 05 22:15:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Group snapshot 4381024d-2948-4e74-b50b-9ef918735093: creating. {{(pid=87085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:15:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Creating offline snapshot ff2908c9-2746-411f-a5db-a01fc7e916dd of volume 9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:15:51 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aff692a-d371-4d37-a4ec-c0b070a2742c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:51 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e Nov 05 22:15:51 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:52 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" returned: 0 in 0.530s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:52 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd 1G Nov 05 22:15:52 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:52 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd 1G" returned: 0 in 0.575s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:52 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd Nov 05 22:15:52 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:52 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd" returned: 0 in 0.352s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:52 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:15:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:52 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd Nov 05 22:15:52 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:53 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd" returned: 0 in 0.330s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:53 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.info Nov 05 22:15:53 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:53 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.info" returned: 0 in 0.417s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:53 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:15:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:53 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.info Nov 05 22:15:53 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:54 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.info" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.668s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fca5de20-cbd4-4186-b8f5-7ccb1ba21339 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4381024d-2948-4e74-b50b-9ef918735093: created successfully Nov 05 22:15:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-d6e402ef-2685-4ce2-b041-d8d997d21495 req-9bff8f47-ab76-4c43-b6ee-afa6216fba1a tempest-TaggedAttachmentsTest-1885649051 None] Terminate volume connection completed successfully. Nov 05 22:15:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-d6e402ef-2685-4ce2-b041-d8d997d21495 req-9bff8f47-ab76-4c43-b6ee-afa6216fba1a tempest-TaggedAttachmentsTest-1885649051 None] Deleting attachment ade1b638-1671-4b79-86d8-fcc5ef388c45. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-ff2908c9-2746-411f-a5db-a01fc7e916dd-3532c876-5ece-4c20-9109-c642342582e1" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-ff2908c9-2746-411f-a5db-a01fc7e916dd-3532c876-5ece-4c20-9109-c642342582e1" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Creating volume 3532c876-5ece-4c20-9109-c642342582e1 from snapshot ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-3532c876-5ece-4c20-9109-c642342582e1" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-3532c876-5ece-4c20-9109-c642342582e1" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] snapshot: ff2908c9-2746-411f-a5db-a01fc7e916dd, volume: 3532c876-5ece-4c20-9109-c642342582e1, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb904033-8c52-437c-a6a8-52c2b791e5e8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:57 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd Nov 05 22:15:57 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:57 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd" returned: 0 in 0.646s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:15:57 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae088250-bc9e-4a5a-ad4f-e3d1f7c37d60]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:15:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:57 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e Nov 05 22:15:57 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:15:58 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Nov 05 22:15:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" returned: 0 in 0.543s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:15:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:15:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:15:58 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:15:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:15:58 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 Nov 05 22:15:58 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:06 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=8,cinder:SELECT=21 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:16:06 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=21,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:16:10 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1" returned: 0 in 12.565s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:10 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e, size 1024.00 MB, duration 12.57 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:16:10 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Converted 1024.00 MB image at 81.48 MB/s Nov 05 22:16:10 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:10 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 Nov 05 22:16:10 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:10 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-3532c876-5ece-4c20-9109-c642342582e1" released by "_copy_volume_from_snapshot" :: held 14.357s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-ff2908c9-2746-411f-a5db-a01fc7e916dd-3532c876-5ece-4c20-9109-c642342582e1" released by "_create_volume_from_snapshot" :: held 14.480s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.535s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c5a3f4d2-30c7-4acc-8e2f-98f743527643 tempest-GroupSnapshotsTest-1595597801 None] Create group from source-snapshot-4381024d-2948-4e74-b50b-9ef918735093 completed successfully. Nov 05 22:16:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-3532c876-5ece-4c20-9109-c642342582e1" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-3532c876-5ece-4c20-9109-c642342582e1" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:12 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2026eed-efba-418a-af64-ecb77a532237]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:13 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 Nov 05 22:16:13 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:13 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1" returned: 0 in 0.482s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:13 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1 Nov 05 22:16:13 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:13 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3532c876-5ece-4c20-9109-c642342582e1" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-3532c876-5ece-4c20-9109-c642342582e1" released by "delete_volume" :: held 0.908s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:13 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['224deded-8cb4-4ea8-98ba-12cfade1ab4d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:13 devstack cinder-volume[87085]: WARNING cinder.quota [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-865807653 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-865807653, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:13 devstack cinder-volume[87085]: WARNING cinder.quota [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-865807653 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-865807653, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:13 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['663dac2c-0667-4291-bc2f-3ec427984ab5', 'd135cf0f-86a2-41aa-b983-3045cda1a87b', '329f65ad-dc74-4c02-be94-8296611192e8', '63705874-092e-4d80-bdd0-c71c27e6a796'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:14 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:16:14 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:14 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.388s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:14 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:14 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d488c6a3-e095-42df-88e5-b78c04faf2fe tempest-GroupSnapshotsTest-1595597801 None] Delete group completed successfully. Nov 05 22:16:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4381024d-2948-4e74-b50b-9ef918735093: deleting Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4381024d-2948-4e74-b50b-9ef918735093: deleting {{(pid=87085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-ff2908c9-2746-411f-a5db-a01fc7e916dd" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-ff2908c9-2746-411f-a5db-a01fc7e916dd" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Deleting offline snapshot ff2908c9-2746-411f-a5db-a01fc7e916dd of volume 9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] snapshot_file for this snap is: volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb0e45-d154-41e1-8323-b1995e0f9f3b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:15 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd Nov 05 22:16:15 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:16 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd" returned: 0 in 0.644s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[587382be-d285-4c28-b976-59e878ae6fc8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Acquiring lock "cinder-ed10c764-a683-4a7b-beae-c68766e48f4c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Lock "cinder-ed10c764-a683-4a7b-beae-c68766e48f4c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:16 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e Nov 05 22:16:16 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Acquiring lock "cinder-quobyte-ed10c764-a683-4a7b-beae-c68766e48f4c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Lock "cinder-quobyte-ed10c764-a683-4a7b-beae-c68766e48f4c" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb22e49-eabc-4478-ac98-f936c7187a61]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:16 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c Nov 05 22:16:16 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:16 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" returned: 0 in 0.731s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:16 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd Nov 05 22:16:16 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:17 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c" returned: 0 in 0.715s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:17 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c Nov 05 22:16:17 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:17 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd" returned: 0 in 0.753s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:17 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ed10c764-a683-4a7b-beae-c68766e48f4c" returned: 0 in 0.465s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:17 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd Nov 05 22:16:17 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Lock "cinder-quobyte-ed10c764-a683-4a7b-beae-c68766e48f4c" released by "delete_volume" :: held 1.262s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Created reservations ['b800221b-542d-4f67-93fe-f7c4a06b8791', '580371cd-5146-489b-bc2c-4433b40c4b50', '2f63ba57-ae21-40f4-ae29-28e0ecc7b075', '44d07734-1383-4b90-a61f-3fe802445062'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:17 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:16:17 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:18 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e.ff2908c9-2746-411f-a5db-a01fc7e916dd" returned: 0 in 0.411s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-ff2908c9-2746-411f-a5db-a01fc7e916dd" released by "_delete_snapshot" :: held 2.702s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" released by "delete_snapshot" :: held 2.744s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:18 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.317s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:18 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Deleted volume successfully. Nov 05 22:16:18 devstack cinder-volume[87085]: WARNING cinder.quota [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-865807653 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-865807653, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4e3c5edb-3401-4d8b-848e-337b42c4737c tempest-TaggedAttachmentsTest-1885649051 None] Lock "cinder-ed10c764-a683-4a7b-beae-c68766e48f4c-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:18 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['6436ea8e-c419-485c-9642-3fc22bb758fc', '6ec1bf58-058f-441c-b0eb-dfc1d2e0ed55', '9266d9b7-4d41-4bcf-88e7-8d00220d1b11', '86322559-0e58-4784-a3d9-338808c772f2'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-93b07358-8012-47a2-92b5-6d6db6fda846 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4381024d-2948-4e74-b50b-9ef918735093: deleted successfully Nov 05 22:16:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6a605-b2f3-46f9-8487-e3e064cf447b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:19 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e Nov 05 22:16:19 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:19 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" returned: 0 in 0.469s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:19 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e Nov 05 22:16:19 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:20 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-9afa32ea-e51d-4318-a2c5-a41f0123bc0e" released by "delete_volume" :: held 0.893s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['c49d9013-5f03-4c6f-8aa5-269a27b9975a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:20 devstack cinder-volume[87085]: WARNING cinder.db.api [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-865807653'] Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['40bc63cb-cad5-4e7c-89ec-57e8adabe18e', '9c1d6c0e-bf67-413b-83fb-92b831fe4a1c', '427febf7-80bc-4abf-be8a-27de393990c9', '34abed6f-3ef7-40e5-aeea-28915009a1f4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:20 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:16:20 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:20 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:20 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fd379eaa-acce-4a9d-9254-648fa2846e89 tempest-GroupSnapshotsTest-1595597801 None] Delete group completed successfully. Nov 05 22:16:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9862d910-a8f2-4ea8-afd5-fbb1ca3831e7 tempest-GroupSnapshotsTest-1595597801 None] Group tempest-GroupSnapshotsTest-Group-630976698: creating Nov 05 22:16:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9862d910-a8f2-4ea8-afd5-fbb1ca3831e7 tempest-GroupSnapshotsTest-1595597801 None] Group tempest-GroupSnapshotsTest-Group-630976698: created successfully Nov 05 22:16:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9862d910-a8f2-4ea8-afd5-fbb1ca3831e7 tempest-GroupSnapshotsTest-1595597801 None] Create group completed successfully. Nov 05 22:16:22 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (35f9ee86-2538-42f9-9f69-d9353eb7deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661726dd-f161-46f8-9697-cdc0c796c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661726dd-f161-46f8-9697-cdc0c796c089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865400521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9697a4ac-5a05-4f69-94da-f88097eecfac,host='devstack@QuobyteHD#QuobyteHD',id=2b862e25-7915-4ca7-a90b-1b0ab64cbbdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:23Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7),volume_type_id=d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe80a73-2cde-4989-ac8b-b96d4bb60338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe80a73-2cde-4989-ac8b-b96d4bb60338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30465cd9-84c5-4cdd-be05-8be776c30f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30465cd9-84c5-4cdd-be05-8be776c30f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b862e25-7915-4ca7-a90b-1b0ab64cbbdc', 'volume_name': 'volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b978d876-5c52-47fa-9ccc-371c60e12a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b978d876-5c52-47fa-9ccc-371c60e12a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34158caa-3f40-49df-8908-b394b2dffe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:23 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Volume 2b862e25-7915-4ca7-a90b-1b0ab64cbbdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc', 'volume_size': 1} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9697a4ac-5a05-4f69-94da-f88097eecfac,created_at=2026-11-05T21:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865400521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9697a4ac-5a05-4f69-94da-f88097eecfac,host='devstack@QuobyteHD#QuobyteHD',id=2b862e25-7915-4ca7-a90b-1b0ab64cbbdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:23Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7),volume_type_id=d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Creating volume 2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:23 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:23 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc 1073741824 Nov 05 22:16:23 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:23 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc 1073741824" returned: 0 in 0.638s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:23 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc Nov 05 22:16:23 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:24 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" returned: 0 in 0.303s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34158caa-3f40-49df-8908-b394b2dffe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339c04af-7860-44da-8c53-25c402efee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:24 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Volume volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc (2b862e25-7915-4ca7-a90b-1b0ab64cbbdc): created successfully Nov 05 22:16:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339c04af-7860-44da-8c53-25c402efee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (35f9ee86-2538-42f9-9f69-d9353eb7deb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:24 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2e4a6be8-a08f-4951-9f4f-b2535f9c201b tempest-GroupSnapshotsTest-1595597801 None] Created volume successfully. Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (78f24c49-11be-4538-8b89-8a1382d063fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42367fcf-c3fa-47a4-871e-06c4cfd77ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42367fcf-c3fa-47a4-871e-06c4cfd77ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477971196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9697a4ac-5a05-4f69-94da-f88097eecfac,host='devstack@QuobyteHD#QuobyteHD',id=d1e6cd12-898a-4975-8180-3801c2b8cb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:26Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7),volume_type_id=d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9f6db6-08b3-4809-b22a-cc8cf5567412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9f6db6-08b3-4809-b22a-cc8cf5567412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b57d589-31c0-4eca-b2d0-018ea7032237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b57d589-31c0-4eca-b2d0-018ea7032237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e6cd12-898a-4975-8180-3801c2b8cb9f', 'volume_name': 'volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e3e91-9c9e-49ea-897d-1f641f6ef6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e3e91-9c9e-49ea-897d-1f641f6ef6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f90168-1064-4009-a7d0-dc8c231a3977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:26 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Volume d1e6cd12-898a-4975-8180-3801c2b8cb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f', 'volume_size': 1} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9697a4ac-5a05-4f69-94da-f88097eecfac,created_at=2026-11-05T21:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477971196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9697a4ac-5a05-4f69-94da-f88097eecfac,host='devstack@QuobyteHD#QuobyteHD',id=d1e6cd12-898a-4975-8180-3801c2b8cb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:26Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7),volume_type_id=d8d397c3-c2b0-4983-bb1f-2bfc3ebff5e7)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Creating volume d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:26 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:16:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:26 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f 1073741824 Nov 05 22:16:26 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:27 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f 1073741824" returned: 0 in 0.634s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:27 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f Nov 05 22:16:27 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:27 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f90168-1064-4009-a7d0-dc8c231a3977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddb0cb3-6d56-4359-86b0-76314cb5e8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:27 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Volume volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f (d1e6cd12-898a-4975-8180-3801c2b8cb9f): created successfully Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddb0cb3-6d56-4359-86b0-76314cb5e8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (78f24c49-11be-4538-8b89-8a1382d063fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:27 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-81b3e26c-9295-4f5b-9d90-78ce92b74caf tempest-GroupSnapshotsTest-1595597801 None] Created volume successfully. Nov 05 22:16:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-78c1b282-bb17-405b-ae84-c90dbeb6b264 tempest-GroupSnapshotsTest-1595597801 None] Update group completed successfully. Nov 05 22:16:30 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5c1dc9d4-2c2a-4d9b-bf7b-3a41899f3456 tempest-GroupSnapshotsTest-1595597801 None] Update group completed successfully. Nov 05 22:16:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4f13ed88-c62a-4da9-a81c-ec1ff4a56519 tempest-GroupSnapshotsTest-1595597801 None] Update group completed successfully. Nov 05 22:16:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-63fd7f99-fbb8-4fea-bcc5-cb7ed9fb86dd tempest-GroupSnapshotsTest-1595597801 None] Update group completed successfully. Nov 05 22:16:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] GroupSnapshot 4d462999-1f93-4bd0-9ffc-ab4659c4f214: creating. Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Group snapshot 4d462999-1f93-4bd0-9ffc-ab4659c4f214: creating. {{(pid=87085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Creating offline snapshot 3445173e-17f9-4372-bad5-b66cd1f5e78f of volume d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Flow 'volume_create_manager' (e1494f6c-1fd8-46b7-b251-2cf6d452373f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df4a1ef-774e-4102-bc37-56f782dc39de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eeea27-273c-486f-81f7-4cfea37ff4d8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df4a1ef-774e-4102-bc37-56f782dc39de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1491931548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a668cfb3-52d8-438e-ba83-60a589d407c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721ddeb11fd044b597f3225cea167b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:35Z,use_quota=True,user_id='30a04cc71b564a0b9c734ea1123a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16e1329-fe0d-42a0-ac5b-0e29ebe75f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16e1329-fe0d-42a0-ac5b-0e29ebe75f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb027fef-c390-4a46-bce9-547dce589e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb027fef-c390-4a46-bce9-547dce589e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a668cfb3-52d8-438e-ba83-60a589d407c5', 'volume_name': 'volume-a668cfb3-52d8-438e-ba83-60a589d407c5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d11593-88b7-4ad8-af2e-345800c73b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25d11593-88b7-4ad8-af2e-345800c73b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806c7fb6-fabb-4dba-9ca5-82b71270678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Volume a668cfb3-52d8-438e-ba83-60a589d407c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a668cfb3-52d8-438e-ba83-60a589d407c5', 'volume_size': 1} Nov 05 22:16:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:35 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f Nov 05 22:16:35 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:36 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f" returned: 0 in 0.617s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:36 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f 1G Nov 05 22:16:36 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:36 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f 1G" returned: 0 in 0.796s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:36 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f Nov 05 22:16:37 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:37 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f" returned: 0 in 0.417s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:37 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:37 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f Nov 05 22:16:37 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:37 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f" returned: 0 in 0.494s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:37 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.info Nov 05 22:16:37 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:38 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.info" returned: 0 in 0.573s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:38 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:38 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.info Nov 05 22:16:38 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:38 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.info" returned: 0 in 0.321s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.398s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Creating offline snapshot edde03e9-6f79-4c7a-a8c2-b83e68151a1b of volume 2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90da19-9ffe-4e45-84fe-5a3ab4707e13]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc Nov 05 22:16:39 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Acquiring lock "cinder-47064b54-17a0-4206-a993-d5c814a7c95c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "cinder-47064b54-17a0-4206-a993-d5c814a7c95c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:39 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Acquiring lock "cinder-quobyte-47064b54-17a0-4206-a993-d5c814a7c95c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" returned: 0 in 0.497s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "cinder-quobyte-47064b54-17a0-4206-a993-d5c814a7c95c" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:39 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b 1G Nov 05 22:16:39 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f6e5c2-87fc-4ed0-88c0-910d7d3a9ff0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c Nov 05 22:16:39 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:39 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b 1G" returned: 0 in 0.472s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:39 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b Nov 05 22:16:39 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:40 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c" returned: 0 in 0.519s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:40 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c Nov 05 22:16:40 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 8 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:16:40 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b" returned: 0 in 0.415s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:40 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:40 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-47064b54-17a0-4206-a993-d5c814a7c95c" returned: 0 in 0.330s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:40 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b Nov 05 22:16:40 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "cinder-quobyte-47064b54-17a0-4206-a993-d5c814a7c95c" released by "delete_volume" :: held 0.906s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Created reservations ['3835b20a-d4a9-4783-ab5e-0cba34ba557a', '27c3e652-5c9e-4272-8a95-2a198b67d4f8', 'f2a325b5-b6e5-4184-bd6a-ba37e9c3761a', '9ab2db28-e420-4f64-aa98-26cc1100c01d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:40 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:16:40 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:40 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:40 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.info Nov 05 22:16:40 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:40 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.334s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Deleted volume successfully. Nov 05 22:16:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c920f44-ac53-4cc7-a011-87f03ecf5dd0 tempest-AttachVolumeShelveTestJSON-745836297 None] Lock "cinder-47064b54-17a0-4206-a993-d5c814a7c95c-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:41 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.info" returned: 0 in 0.310s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:41 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:41 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.info Nov 05 22:16:41 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:41 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.info" returned: 0 in 0.289s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.695s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1491931548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a668cfb3-52d8-438e-ba83-60a589d407c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721ddeb11fd044b597f3225cea167b7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:35Z,use_quota=True,user_id='30a04cc71b564a0b9c734ea1123a3234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Creating volume a668cfb3-52d8-438e-ba83-60a589d407c5 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:41 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:16:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:41 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 1073741824 Nov 05 22:16:41 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d6a41f82-43c8-4a98-a0d3-e394512ca8f2 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4d462999-1f93-4bd0-9ffc-ab4659c4f214: created successfully Nov 05 22:16:42 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 1073741824" returned: 0 in 0.818s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:42 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 Nov 05 22:16:42 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4d462999-1f93-4bd0-9ffc-ab4659c4f214: deleting Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4d462999-1f93-4bd0-9ffc-ab4659c4f214: deleting {{(pid=87085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-d1e6cd12-898a-4975-8180-3801c2b8cb9f" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-d1e6cd12-898a-4975-8180-3801c2b8cb9f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-3445173e-17f9-4372-bad5-b66cd1f5e78f" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-3445173e-17f9-4372-bad5-b66cd1f5e78f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Deleting offline snapshot 3445173e-17f9-4372-bad5-b66cd1f5e78f of volume d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] snapshot_file for this snap is: volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d997f3-ce84-487e-8740-629edf187bb1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:42 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5" returned: 0 in 0.514s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806c7fb6-fabb-4dba-9ca5-82b71270678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a668cfb3-52d8-438e-ba83-60a589d407c5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e8e287-9b50-4b2b-bb52-51ddf77d7061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:42 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Volume volume-a668cfb3-52d8-438e-ba83-60a589d407c5 (a668cfb3-52d8-438e-ba83-60a589d407c5): created successfully Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e8e287-9b50-4b2b-bb52-51ddf77d7061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Flow 'volume_create_manager' (e1494f6c-1fd8-46b7-b251-2cf6d452373f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f6db0f5d-ed04-4631-8dec-5154cc0d1115 tempest-VolumesAdminNegativeTest-758457717 None] Created volume successfully. Nov 05 22:16:43 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f Nov 05 22:16:43 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:43 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f" returned: 0 in 0.764s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b4e7c4-cc02-41db-8b5c-db602f52096a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:43 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f Nov 05 22:16:43 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:44 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f" returned: 0 in 0.592s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:44 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f Nov 05 22:16:44 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Acquiring lock "cinder-a668cfb3-52d8-438e-ba83-60a589d407c5-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Lock "cinder-a668cfb3-52d8-438e-ba83-60a589d407c5-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Acquiring lock "cinder-quobyte-a668cfb3-52d8-438e-ba83-60a589d407c5" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Lock "cinder-quobyte-a668cfb3-52d8-438e-ba83-60a589d407c5" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0245067d-d425-464a-b1b5-7a963ad7c5a4]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:44 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 Nov 05 22:16:44 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:45 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f" returned: 0 in 0.924s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:45 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f Nov 05 22:16:45 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:45 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5" returned: 0 in 0.576s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:45 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5 Nov 05 22:16:45 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:45 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f.3445173e-17f9-4372-bad5-b66cd1f5e78f" returned: 0 in 0.322s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-3445173e-17f9-4372-bad5-b66cd1f5e78f" released by "_delete_snapshot" :: held 2.797s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-d1e6cd12-898a-4975-8180-3801c2b8cb9f" released by "delete_snapshot" :: held 2.856s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-edde03e9-6f79-4c7a-a8c2-b83e68151a1b" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-edde03e9-6f79-4c7a-a8c2-b83e68151a1b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Deleting offline snapshot edde03e9-6f79-4c7a-a8c2-b83e68151a1b of volume 2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] snapshot_file for this snap is: volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:16:45 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a668cfb3-52d8-438e-ba83-60a589d407c5" returned: 0 in 0.389s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc1e924-20f7-4714-98a8-008bdabbc225]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Lock "cinder-quobyte-a668cfb3-52d8-438e-ba83-60a589d407c5" released by "delete_volume" :: held 1.075s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Created reservations ['4c957aaa-e5c5-4f9f-95a0-861cb2126bbd', '32b45ab7-2dd7-4e68-8efd-8e39e13997e9', '9f729bc9-d01b-4951-8246-5ec3d8bfbff0', 'e4beb763-d02a-4339-aa23-554f695ba9c5'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:45 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:45 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:45 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:16:45 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:46 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b" returned: 0 in 0.496s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:16:46 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.359s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:46 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Deleted volume successfully. Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c34025e-9d5f-4689-9734-5f1f19e63088]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5a0c9df-6d13-4864-b771-b3fde67a3c6b tempest-VolumesAdminNegativeTest-758457717 None] Lock "cinder-a668cfb3-52d8-438e-ba83-60a589d407c5-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:46 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc Nov 05 22:16:46 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:46 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" returned: 0 in 0.454s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:46 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b Nov 05 22:16:46 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:47 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b" returned: 0 in 0.435s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:47 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b Nov 05 22:16:47 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:47 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc.edde03e9-6f79-4c7a-a8c2-b83e68151a1b" returned: 0 in 0.555s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-edde03e9-6f79-4c7a-a8c2-b83e68151a1b" released by "_delete_snapshot" :: held 2.208s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" released by "delete_snapshot" :: held 2.252s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:47 devstack cinder-volume[87085]: WARNING cinder.quota [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1123650050 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1123650050, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:47 devstack cinder-volume[87085]: WARNING cinder.quota [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1123650050 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1123650050, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:47 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['ea0215cf-13f2-45c2-808b-bea71c98b3cf', '4afbcf4f-cff4-48e5-8684-fff1c837f7c3', 'ebb35fdb-3806-47db-b435-39149b510495', 'a288f004-8d3e-42a0-9327-8b80511d951c'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:48 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['cd551862-f4e4-4763-925b-535ff2fea030', '50fb1cbe-a01f-4a87-8bb8-238f89a98384', '8ca5bef9-9020-47b1-9a51-78e1fd295afc', '42bd94f6-a0c1-4ecf-ac97-e2c3c89917b7'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:48 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-03c9349f-ce8b-41d5-a2a9-32e60f0a7c75 tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 4d462999-1f93-4bd0-9ffc-ab4659c4f214: deleted successfully Nov 05 22:16:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" acquired by "delete_volume" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1106fae6-0cc7-4918-8dc6-09696dc6b569]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:49 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc Nov 05 22:16:49 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:49 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" returned: 0 in 0.479s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:49 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc Nov 05 22:16:49 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:49 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" returned: 0 in 0.333s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-2b862e25-7915-4ca7-a90b-1b0ab64cbbdc" released by "delete_volume" :: held 0.927s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-d1e6cd12-898a-4975-8180-3801c2b8cb9f" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:16:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-d1e6cd12-898a-4975-8180-3801c2b8cb9f" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:16:50 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5cc5a-7d2e-43ab-a942-0da357c4f933]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:50 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f Nov 05 22:16:50 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:50 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f" returned: 0 in 0.566s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:50 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f Nov 05 22:16:50 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:50 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1e6cd12-898a-4975-8180-3801c2b8cb9f" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:50 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-d1e6cd12-898a-4975-8180-3801c2b8cb9f" released by "delete_volume" :: held 1.005s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['68914ef8-2631-4808-92da-3510e213dd05'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:51 devstack cinder-volume[87085]: WARNING cinder.quota [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1123650050 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1123650050, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['ae25cc67-220a-49e1-9def-ad152e78beb2', 'a39ffc8c-403d-48a7-a751-5c744c5d9d95', 'a73993c4-fb0c-4208-91f0-99e6e2047700', '8cb5f8b7-ed2a-41fe-9c16-28964cc6ccb0'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['99c4d2ea-2122-4b3d-b16d-cd0821587633', '34ac839d-45a7-4a3d-a5bd-83c043208420', '62799c10-3062-443e-a89b-0d76031bc898', '617f4b9e-d86e-4122-9ead-ed6a81659701'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:51 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:16:51 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:51 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.433s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:51 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:16:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-eefef374-eb07-4c75-a8b3-295e881f49a0 tempest-GroupSnapshotsTest-1595597801 None] Delete group completed successfully. Nov 05 22:16:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c0dc4c56-f20e-4bff-b073-8892203e32de tempest-GroupSnapshotsTest-1595597801 None] Group tempest-GroupSnapshotsTest-Group-738116516: creating Nov 05 22:16:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c0dc4c56-f20e-4bff-b073-8892203e32de tempest-GroupSnapshotsTest-1595597801 None] Group tempest-GroupSnapshotsTest-Group-738116516: created successfully Nov 05 22:16:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c0dc4c56-f20e-4bff-b073-8892203e32de tempest-GroupSnapshotsTest-1595597801 None] Create group completed successfully. Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (acbc75ce-f363-4b7d-ad3d-04fb44d25cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1798e5e1-a833-4375-89b2-0907a5f8c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1798e5e1-a833-4375-89b2-0907a5f8c16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897574952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dad814c-1850-40c1-b571-cef237946bb5,host='devstack@QuobyteHD#QuobyteHD',id=259c4432-aafb-4162-a241-c2bcd924ac51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:54Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7826422-8809-4a34-a4de-e71776baa3be),volume_type_id=b7826422-8809-4a34-a4de-e71776baa3be)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f8797a-07a0-463a-99f8-20737264bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f8797a-07a0-463a-99f8-20737264bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50971781-672e-4d5e-9f9d-e857ace4c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50971781-672e-4d5e-9f9d-e857ace4c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259c4432-aafb-4162-a241-c2bcd924ac51', 'volume_name': 'volume-259c4432-aafb-4162-a241-c2bcd924ac51', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaabf40-d9d7-4955-8c4b-b3cf7a31a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceaabf40-d9d7-4955-8c4b-b3cf7a31a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a1839b-2e1d-486e-a3f2-953feb649c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Volume 259c4432-aafb-4162-a241-c2bcd924ac51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259c4432-aafb-4162-a241-c2bcd924ac51', 'volume_size': 1} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8dad814c-1850-40c1-b571-cef237946bb5,created_at=2026-11-05T21:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897574952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8dad814c-1850-40c1-b571-cef237946bb5,host='devstack@QuobyteHD#QuobyteHD',id=259c4432-aafb-4162-a241-c2bcd924ac51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ca85f60321486fbe4f931afa31649d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:54Z,use_quota=True,user_id='0c20ab36397d4b3189927cd30be55f0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7826422-8809-4a34-a4de-e71776baa3be),volume_type_id=b7826422-8809-4a34-a4de-e71776baa3be)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Creating volume 259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:54 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:54 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 1073741824 Nov 05 22:16:54 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:54 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 1073741824" returned: 0 in 0.639s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:54 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 Nov 05 22:16:54 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:55 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51" returned: 0 in 0.315s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a1839b-2e1d-486e-a3f2-953feb649c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259c4432-aafb-4162-a241-c2bcd924ac51', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c16917-c03e-4be6-a508-61d18c523403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Volume volume-259c4432-aafb-4162-a241-c2bcd924ac51 (259c4432-aafb-4162-a241-c2bcd924ac51): created successfully Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c16917-c03e-4be6-a508-61d18c523403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Flow 'volume_create_manager' (acbc75ce-f363-4b7d-ad3d-04fb44d25cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-66381a8c-eccb-4dfb-867b-01673d935d23 tempest-GroupSnapshotsTest-1595597801 None] Created volume successfully. Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Flow 'volume_create_manager' (463b708c-a2c3-4028-b561-25b571dafb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90388e2f-7202-4290-a6f0-498395c7acf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90388e2f-7202-4290-a6f0-498395c7acf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-628582227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982fe175-8661-4015-ba41-52265dd54af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fceef3ffdd4048af93ab4edbaf4f24a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:55Z,use_quota=True,user_id='670720e550b3456cb180869988c450df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d796ae-0923-4efe-b172-52f0eff3ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d796ae-0923-4efe-b172-52f0eff3ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da038e8d-f90d-40e8-9894-e7886137fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da038e8d-f90d-40e8-9894-e7886137fb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982fe175-8661-4015-ba41-52265dd54af2', 'volume_name': 'volume-982fe175-8661-4015-ba41-52265dd54af2', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d1b029-02c4-4af0-9cd8-bbcf77704328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d1b029-02c4-4af0-9cd8-bbcf77704328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e9a308-15bf-4d01-a5c6-9cd832597f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Volume 982fe175-8661-4015-ba41-52265dd54af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982fe175-8661-4015-ba41-52265dd54af2', 'volume_size': 1} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-628582227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982fe175-8661-4015-ba41-52265dd54af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fceef3ffdd4048af93ab4edbaf4f24a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:16:55Z,use_quota=True,user_id='670720e550b3456cb180869988c450df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Creating volume 982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:16:55 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:55 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 1073741824 Nov 05 22:16:55 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] GroupSnapshot 08f0b4d7-7be1-4fb9-87f1-115586b13030: creating. Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Group snapshot 08f0b4d7-7be1-4fb9-87f1-115586b13030: creating. {{(pid=87085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:16:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:56 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 1073741824" returned: 0 in 0.520s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:56 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 Nov 05 22:16:56 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:56 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2" returned: 0 in 0.320s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.654s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Creating offline snapshot f9dcfa2f-1363-4879-a471-30802a9f03a4 of volume 259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e9a308-15bf-4d01-a5c6-9cd832597f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982fe175-8661-4015-ba41-52265dd54af2', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bfb2e8-be6d-44df-91ea-641312adadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[508aadde-8404-4c5f-b47b-d9c1b7277333]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:56 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Volume volume-982fe175-8661-4015-ba41-52265dd54af2 (982fe175-8661-4015-ba41-52265dd54af2): created successfully Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bfb2e8-be6d-44df-91ea-641312adadf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:16:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Flow 'volume_create_manager' (463b708c-a2c3-4028-b561-25b571dafb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:16:56 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-6b30fb8f-1290-4a72-8201-17cbca43b22f req-2d7a726a-cd58-42db-a05e-3d32a3850d07 tempest-VolumesSnapshotsTestJSON-723261460 None] Created volume successfully. Nov 05 22:16:56 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 Nov 05 22:16:56 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:57 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51" returned: 0 in 0.467s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:57 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 1G Nov 05 22:16:57 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:57 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 1G" returned: 0 in 0.533s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259c4432-aafb-4162-a241-c2bcd924ac51 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:57 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259c4432-aafb-4162-a241-c2bcd924ac51 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 Nov 05 22:16:57 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:58 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-259c4432-aafb-4162-a241-c2bcd924ac51 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4" returned: 0 in 0.445s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:58 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:58 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 Nov 05 22:16:58 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:16:58 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4" returned: 0 in 0.409s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:58 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.info Nov 05 22:16:58 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:58 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.info" returned: 0 in 0.265s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:58 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:16:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:58 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.info Nov 05 22:16:58 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:16:59 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Nov 05 22:16:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.info" returned: 0 in 0.382s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:16:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:16:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.023s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:16:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Creating offline snapshot cf39d46d-7a31-4c03-b310-75a11a8d3a51 of volume 982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:16:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6445e73a-5d8f-4dcf-818a-801baf73c5a6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:16:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:16:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0777e2ae-1212-4d8e-ac43-cc24f4360f9e tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 08f0b4d7-7be1-4fb9-87f1-115586b13030: created successfully Nov 05 22:16:59 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 Nov 05 22:16:59 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:00 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2" returned: 0 in 0.627s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:00 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 1G Nov 05 22:17:00 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 08f0b4d7-7be1-4fb9-87f1-115586b13030: deleting Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 08f0b4d7-7be1-4fb9-87f1-115586b13030: deleting {{(pid=87085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-259c4432-aafb-4162-a241-c2bcd924ac51" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-259c4432-aafb-4162-a241-c2bcd924ac51" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-f9dcfa2f-1363-4879-a471-30802a9f03a4" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-f9dcfa2f-1363-4879-a471-30802a9f03a4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Deleting offline snapshot f9dcfa2f-1363-4879-a471-30802a9f03a4 of volume 259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] snapshot_file for this snap is: volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[15838b18-e892-406d-839e-74533279a605]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:00 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 1G" returned: 0 in 0.799s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982fe175-8661-4015-ba41-52265dd54af2 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:00 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 Nov 05 22:17:00 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:00 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982fe175-8661-4015-ba41-52265dd54af2 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 Nov 05 22:17:00 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:01 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:01 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4" returned: 0 in 0.658s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-259c4432-aafb-4162-a241-c2bcd924ac51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982fe175-8661-4015-ba41-52265dd54af2 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51" returned: 0 in 0.518s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:01 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 is being set with open permissions: ugo+rw Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e5ac28-1c07-4eb3-baaf-ada871ba9d41]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:01 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 Nov 05 22:17:01 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:01 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 Nov 05 22:17:01 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:01 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51" returned: 0 in 0.461s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:01 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.info Nov 05 22:17:01 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:01 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51" returned: 0 in 0.595s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:02 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 Nov 05 22:17:02 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:02 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.info" returned: 0 in 0.407s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:02 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.info is being set with open permissions: ugo+rw Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:02 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.info Nov 05 22:17:02 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:02 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4" returned: 0 in 0.594s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:02 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4 Nov 05 22:17:02 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:02 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.info" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.447s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-74e936ef-f3dd-4f44-acbb-fed5ad7fc296 req-a96177e2-de51-4349-b1d5-20393d799a16 tempest-VolumesSnapshotsTestJSON-723261460 None] Create snapshot completed successfully Nov 05 22:17:02 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51.f9dcfa2f-1363-4879-a471-30802a9f03a4" returned: 0 in 0.386s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-f9dcfa2f-1363-4879-a471-30802a9f03a4" released by "_delete_snapshot" :: held 2.387s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-259c4432-aafb-4162-a241-c2bcd924ac51" released by "delete_snapshot" :: held 2.420s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:03 devstack cinder-volume[87085]: WARNING cinder.quota [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1441838255 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1441838255, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:03 devstack cinder-volume[87085]: WARNING cinder.quota [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1441838255 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1441838255, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['b42842d0-2564-448c-adfc-1059b41da03c', 'a40b807c-7a8a-46bf-b355-1e7a25a0868e', '1f72ba32-c216-4386-837b-bdb22c45fdd5', 'd293dc70-9b81-420b-841b-5cdecdc1c8d4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "cinder-cf39d46d-7a31-4c03-b310-75a11a8d3a51-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-cf39d46d-7a31-4c03-b310-75a11a8d3a51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "cinder-quobyte-982fe175-8661-4015-ba41-52265dd54af2" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1c03e729-18d8-446e-93cc-0fbc01c33c9e tempest-GroupSnapshotsTest-1595597801 None] group_snapshot 08f0b4d7-7be1-4fb9-87f1-115586b13030: deleted successfully Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-quobyte-982fe175-8661-4015-ba41-52265dd54af2" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "cinder-quobyte-cf39d46d-7a31-4c03-b310-75a11a8d3a51" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-quobyte-cf39d46d-7a31-4c03-b310-75a11a8d3a51" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Deleting offline snapshot cf39d46d-7a31-4c03-b310-75a11a8d3a51 of volume 982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] snapshot_file for this snap is: volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25926a-9bb7-41d2-8d4b-fbabeeee96b6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:03 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 Nov 05 22:17:03 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:04 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51" returned: 0 in 0.589s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982fe175-8661-4015-ba41-52265dd54af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7465b6c4-5aa6-4201-952e-14d121aedaaa]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:04 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 Nov 05 22:17:04 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "cinder-quobyte-259c4432-aafb-4162-a241-c2bcd924ac51" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-259c4432-aafb-4162-a241-c2bcd924ac51" acquired by "delete_volume" :: waited 0.045s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34059e7-b623-4b35-8ccc-5d5682175e7d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:04 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 Nov 05 22:17:04 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:04 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2" returned: 0 in 0.681s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:05 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 Nov 05 22:17:05 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:05 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51" returned: 0 in 0.774s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:05 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51 Nov 05 22:17:05 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:05 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51" returned: 0 in 0.871s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:05 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51 Nov 05 22:17:05 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:06 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-259c4432-aafb-4162-a241-c2bcd924ac51" returned: 0 in 0.761s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Lock "cinder-quobyte-259c4432-aafb-4162-a241-c2bcd924ac51" released by "delete_volume" :: held 1.694s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['71676d4a-24cd-42c0-bb5e-aae970d59388'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:06 devstack cinder-volume[87085]: WARNING cinder.quota [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1441838255 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1441838255, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Created reservations ['23f74e1a-f033-4068-b910-739bc02cb2b1', '056171da-de22-4879-8a4b-ff4977db44c1', '601a849a-a71c-495b-916f-3d1f9152ffce', 'ad6454d0-a9fa-4926-ad25-4a317558babf'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=120,cinder:SELECT=119,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:17:06 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2.cf39d46d-7a31-4c03-b310-75a11a8d3a51" returned: 0 in 0.846s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-quobyte-cf39d46d-7a31-4c03-b310-75a11a8d3a51" released by "_delete_snapshot" :: held 3.288s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-quobyte-982fe175-8661-4015-ba41-52265dd54af2" released by "delete_snapshot" :: held 3.338s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=121,cinder:INSERT=38,cinder:UPDATE=137,cinder:DELETE=4 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:06 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:06 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:06 devstack cinder-volume[87085]: WARNING cinder.quota [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG cinder.quota [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Created reservations ['10ae7316-465d-4624-96e1-47196b09a2d6', '7b921263-272e-4dce-854a-c61690eb7c2f', '27100843-6d12-43ba-be72-f1460f76fe1a', '9664654d-c97d-44b2-bf89-a2020d2df268'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Delete snapshot completed successfully. Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f98c14c7-a07e-4bbd-ae81-73d76d2bf3c7 req-ee8bb298-9b4b-4635-bc98-b367d6823da2 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-cf39d46d-7a31-4c03-b310-75a11a8d3a51-delete_snapshot" released by "delete_snapshot" :: held 3.801s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "cinder-982fe175-8661-4015-ba41-52265dd54af2-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-982fe175-8661-4015-ba41-52265dd54af2-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:07 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.557s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f0f39984-502d-44ad-aceb-206c38e9e511 tempest-GroupSnapshotsTest-1595597801 None] Delete group completed successfully. Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "cinder-quobyte-982fe175-8661-4015-ba41-52265dd54af2" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-quobyte-982fe175-8661-4015-ba41-52265dd54af2" acquired by "delete_volume" :: waited 0.036s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[96249914-b85b-4bfe-8288-13caf63330ac]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:07 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 Nov 05 22:17:07 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:08 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2" returned: 0 in 0.624s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:08 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2 Nov 05 22:17:08 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:08 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-982fe175-8661-4015-ba41-52265dd54af2" returned: 0 in 0.432s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-quobyte-982fe175-8661-4015-ba41-52265dd54af2" released by "delete_volume" :: held 1.205s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG cinder.quota [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Created reservations ['01ab6f7b-034f-4f1d-a294-e613cb142bed', 'b9b76ded-f5f8-4a98-a6ba-c67495e59085', '50b2d147-ce10-4fe6-b018-5408b379ee16', 'a8db32ed-6b65-4c74-b9f3-9692bd21aafd'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:09 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:09 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:09 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.492s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:09 devstack cinder-volume[87085]: DEBUG cinder.manager [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Deleted volume successfully. Nov 05 22:17:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-f4626660-5dd6-4686-9b7d-c231a4154947 req-745f0ea6-c0a1-4ad1-960b-13400622b690 tempest-VolumesSnapshotsTestJSON-723261460 None] Lock "cinder-982fe175-8661-4015-ba41-52265dd54af2-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:18 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=13 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Flow 'volume_create_manager' (a33c1431-b860-4777-a6ab-e5e852c7d5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607a276e-1fa9-4b0c-bbf2-1b27ff6ad1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607a276e-1fa9-4b0c-bbf2-1b27ff6ad1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2110831462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6f94bc-d588-407a-bd6b-e0c17dbb663c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db3d6dd7bf4d4d3c85f0ccc0e7f67af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:19Z,use_quota=True,user_id='ec1b04b4b3a246a2b73d3ab4056bdae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9c8702-54a7-40a2-ac1c-7988f75f58e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9c8702-54a7-40a2-ac1c-7988f75f58e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6da7b44-ad17-4952-b76d-2c0972c2873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6da7b44-ad17-4952-b76d-2c0972c2873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6f94bc-d588-407a-bd6b-e0c17dbb663c', 'volume_name': 'volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facef223-80b4-41e4-a11b-ae96666cfc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facef223-80b4-41e4-a11b-ae96666cfc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6e8a57-4cf6-4b8b-8fce-8faf9a134146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:19 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Volume bc6f94bc-d588-407a-bd6b-e0c17dbb663c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c', 'volume_size': 1} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2110831462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6f94bc-d588-407a-bd6b-e0c17dbb663c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db3d6dd7bf4d4d3c85f0ccc0e7f67af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:19Z,use_quota=True,user_id='ec1b04b4b3a246a2b73d3ab4056bdae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Creating volume bc6f94bc-d588-407a-bd6b-e0c17dbb663c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:19 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:19 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c 1073741824 Nov 05 22:17:19 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:20 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c 1073741824" returned: 0 in 0.701s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:20 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c Nov 05 22:17:20 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7f3b6388-6fd5-4753-8ef8-7f6a0d60b47d tempest-GroupSnapshotsV319Test-1289556892 None] Group tempest-GroupSnapshotsV319Test-Group-1840962451: creating Nov 05 22:17:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7f3b6388-6fd5-4753-8ef8-7f6a0d60b47d tempest-GroupSnapshotsV319Test-1289556892 None] Group tempest-GroupSnapshotsV319Test-Group-1840962451: created successfully Nov 05 22:17:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7f3b6388-6fd5-4753-8ef8-7f6a0d60b47d tempest-GroupSnapshotsV319Test-1289556892 None] Create group completed successfully. Nov 05 22:17:20 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c" returned: 0 in 0.444s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6e8a57-4cf6-4b8b-8fce-8faf9a134146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e548c9b0-cc38-4339-bc65-199da206923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:20 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Volume volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c (bc6f94bc-d588-407a-bd6b-e0c17dbb663c): created successfully Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e548c9b0-cc38-4339-bc65-199da206923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Flow 'volume_create_manager' (a33c1431-b860-4777-a6ab-e5e852c7d5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-b8b953e3-020a-453f-b36f-0a80ccf1d0a9 req-138f0391-8054-4a15-b803-651898611fc6 tempest-VolumesGetTestJSON-978994835 None] Created volume successfully. Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Flow 'volume_create_manager' (d3feb18b-662c-49e1-95a6-e3c1257fb678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1dabe-5379-42dc-acc8-ffb8f6207359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff1dabe-5379-42dc-acc8-ffb8f6207359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1782917208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=254f5e52-1907-44b4-856e-323e3f0ea829,host='devstack@QuobyteHD#QuobyteHD',id=7a57d132-9821-4151-8f48-1d34f0c9f261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0056be14c341bfb02a90d5d87430e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:22Z,use_quota=True,user_id='3490f68a38ea408d9f8f706c07fd5afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9c6a94-72e3-4fb0-891a-169c18610f92),volume_type_id=9a9c6a94-72e3-4fb0-891a-169c18610f92)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689a77d9-4526-48bd-a75e-b835cf0d21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689a77d9-4526-48bd-a75e-b835cf0d21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb6b991-253d-41bc-9c98-4b426e6b032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb6b991-253d-41bc-9c98-4b426e6b032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a57d132-9821-4151-8f48-1d34f0c9f261', 'volume_name': 'volume-7a57d132-9821-4151-8f48-1d34f0c9f261', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3dd298-fbbf-4ce7-a20c-643a7bbad2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3dd298-fbbf-4ce7-a20c-643a7bbad2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cb30c3-5afc-4dd8-a438-61d10607b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:22 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Volume 7a57d132-9821-4151-8f48-1d34f0c9f261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a57d132-9821-4151-8f48-1d34f0c9f261', 'volume_size': 1} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=254f5e52-1907-44b4-856e-323e3f0ea829,created_at=2026-11-05T21:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1782917208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=254f5e52-1907-44b4-856e-323e3f0ea829,host='devstack@QuobyteHD#QuobyteHD',id=7a57d132-9821-4151-8f48-1d34f0c9f261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0056be14c341bfb02a90d5d87430e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:22Z,use_quota=True,user_id='3490f68a38ea408d9f8f706c07fd5afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a9c6a94-72e3-4fb0-891a-169c18610f92),volume_type_id=9a9c6a94-72e3-4fb0-891a-169c18610f92)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Creating volume 7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:22 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:22 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 1073741824 Nov 05 22:17:22 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Acquiring lock "cinder-bc6f94bc-d588-407a-bd6b-e0c17dbb663c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Lock "cinder-bc6f94bc-d588-407a-bd6b-e0c17dbb663c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:22 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Flow 'volume_create_manager' (02317fba-54c7-4745-bc08-30d28ea480a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65617fc8-3ff9-42da-a39d-693172049908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65617fc8-3ff9-42da-a39d-693172049908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1254981524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda24308-1c46-4866-84ab-14798283a84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece79f1e77634aa2822af5510f8a4818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:23Z,use_quota=True,user_id='cd5802fac73e4498bef0e7e89230d846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef120d7-163c-4758-b02b-f9c82d322908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef120d7-163c-4758-b02b-f9c82d322908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b96ae99-3b36-4348-882b-d022d1a65a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b96ae99-3b36-4348-882b-d022d1a65a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda24308-1c46-4866-84ab-14798283a84d', 'volume_name': 'volume-eda24308-1c46-4866-84ab-14798283a84d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc15e47-65bc-4af4-99ce-d9fc57f04c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdc15e47-65bc-4af4-99ce-d9fc57f04c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9751d96c-a8b8-4ec5-b18b-5f3875c1a6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:23 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Volume eda24308-1c46-4866-84ab-14798283a84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda24308-1c46-4866-84ab-14798283a84d', 'volume_size': 1} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Acquiring lock "cinder-quobyte-bc6f94bc-d588-407a-bd6b-e0c17dbb663c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Lock "cinder-quobyte-bc6f94bc-d588-407a-bd6b-e0c17dbb663c" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4a0573-1542-43d4-9016-7e4c6dd3a051]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:23 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c Nov 05 22:17:23 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:23 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 1073741824" returned: 0 in 0.674s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:23 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 Nov 05 22:17:23 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:23 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:23 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c Nov 05 22:17:23 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:23 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261" returned: 0 in 0.333s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.684s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1254981524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda24308-1c46-4866-84ab-14798283a84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece79f1e77634aa2822af5510f8a4818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:23Z,use_quota=True,user_id='cd5802fac73e4498bef0e7e89230d846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Creating volume eda24308-1c46-4866-84ab-14798283a84d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:23 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28cb30c3-5afc-4dd8-a438-61d10607b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a57d132-9821-4151-8f48-1d34f0c9f261', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d 1073741824 Nov 05 22:17:23 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bf9824-d8f6-4911-95b7-58b02263f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:23 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Volume volume-7a57d132-9821-4151-8f48-1d34f0c9f261 (7a57d132-9821-4151-8f48-1d34f0c9f261): created successfully Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bf9824-d8f6-4911-95b7-58b02263f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Flow 'volume_create_manager' (d3feb18b-662c-49e1-95a6-e3c1257fb678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3a134c1d-ca82-4e98-a031-db44f55f4fa8 tempest-GroupSnapshotsV319Test-1289556892 None] Created volume successfully. Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc6f94bc-d588-407a-bd6b-e0c17dbb663c" returned: 0 in 0.379s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:24 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Lock "cinder-quobyte-bc6f94bc-d588-407a-bd6b-e0c17dbb663c" released by "delete_volume" :: held 0.909s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.quota [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Created reservations ['b5053293-82f1-4051-b67f-8e2a04d60125', 'ca45d44d-3d88-4faf-9511-be9ed72dd9fa', '12134136-f0cc-4373-9945-c9a71932fa1c', 'bf8296df-981a-470b-90a5-a3cb62fe0a14'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:24 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:24 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:24 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d 1073741824" returned: 0 in 0.566s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:24 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d Nov 05 22:17:24 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:24 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.manager [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:24 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Deleted volume successfully. Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-42bc448b-4700-4a84-b508-7f4d02a74004 req-17637dce-8a1d-4361-9739-ced4e5ea3ded tempest-VolumesGetTestJSON-978994835 None] Lock "cinder-bc6f94bc-d588-407a-bd6b-e0c17dbb663c-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:24 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d" returned: 0 in 0.296s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9751d96c-a8b8-4ec5-b18b-5f3875c1a6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda24308-1c46-4866-84ab-14798283a84d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f0225d-938c-45a9-badc-62c7ab179a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:24 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Volume volume-eda24308-1c46-4866-84ab-14798283a84d (eda24308-1c46-4866-84ab-14798283a84d): created successfully Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f0225d-938c-45a9-badc-62c7ab179a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Flow 'volume_create_manager' (02317fba-54c7-4745-bc08-30d28ea480a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:24 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-610a70eb-b830-4372-9126-e9d4abae530e tempest-ServersNegativeTestJSON-1671584495 None] Created volume successfully. Nov 05 22:17:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] GroupSnapshot b6c53d2c-bb5a-4ee0-9a6a-13ed22529f5a: creating. Nov 05 22:17:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Group snapshot b6c53d2c-bb5a-4ee0-9a6a-13ed22529f5a: creating. {{(pid=87085) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 22:17:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Creating offline snapshot e94909d7-02c9-4fd0-a319-2a3de6754a4e of volume 7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:17:25 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[98911968-38fd-46df-914c-3b32c782abe9]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:25 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 Nov 05 22:17:25 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:26 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:26 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e 1G Nov 05 22:17:26 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:26 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e 1G" returned: 0 in 0.547s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a57d132-9821-4151-8f48-1d34f0c9f261 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:26 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a57d132-9821-4151-8f48-1d34f0c9f261 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e Nov 05 22:17:26 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:26 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a57d132-9821-4151-8f48-1d34f0c9f261 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e" returned: 0 in 0.317s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:26 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:17:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:26 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e Nov 05 22:17:26 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:27 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e" returned: 0 in 0.362s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:27 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.info Nov 05 22:17:27 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:27 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.info" returned: 0 in 0.369s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:27 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:17:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:27 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.info Nov 05 22:17:27 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:28 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.info" returned: 0 in 0.339s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-01d2a8a6-30c2-454e-9f85-8835a96e50df tempest-GroupSnapshotsV319Test-1289556892 None] group_snapshot b6c53d2c-bb5a-4ee0-9a6a-13ed22529f5a: created successfully Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Flow 'volume_create_manager' (ccfede36-214f-4a7b-8353-3110e1e4efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f957487-1c5c-416a-90eb-4ee2f000c8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f957487-1c5c-416a-90eb-4ee2f000c8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-876044585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15be78a-411e-41f4-bed7-3510fc086644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece79f1e77634aa2822af5510f8a4818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:28Z,use_quota=True,user_id='cd5802fac73e4498bef0e7e89230d846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ccf5db-d146-40e4-bf53-7000dc9976bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ccf5db-d146-40e4-bf53-7000dc9976bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4160fc00-1d58-4a76-b2ae-621eaa80837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4160fc00-1d58-4a76-b2ae-621eaa80837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15be78a-411e-41f4-bed7-3510fc086644', 'volume_name': 'volume-b15be78a-411e-41f4-bed7-3510fc086644', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2d7b86-7c9a-47b1-8302-152159ae5e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2d7b86-7c9a-47b1-8302-152159ae5e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ab84f8-b3e2-42a7-bcfc-a68145d5bb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:28 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Volume b15be78a-411e-41f4-bed7-3510fc086644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15be78a-411e-41f4-bed7-3510fc086644', 'volume_size': 1} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-876044585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15be78a-411e-41f4-bed7-3510fc086644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece79f1e77634aa2822af5510f8a4818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:28Z,use_quota=True,user_id='cd5802fac73e4498bef0e7e89230d846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Creating volume b15be78a-411e-41f4-bed7-3510fc086644 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:28 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:28 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 1073741824 Nov 05 22:17:28 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:29 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 1073741824" returned: 0 in 0.705s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:29 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 Nov 05 22:17:29 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] group_snapshot b6c53d2c-bb5a-4ee0-9a6a-13ed22529f5a: deleting Nov 05 22:17:29 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644" returned: 0 in 0.459s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] group_snapshot b6c53d2c-bb5a-4ee0-9a6a-13ed22529f5a: deleting {{(pid=87085) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2ab84f8-b3e2-42a7-bcfc-a68145d5bb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15be78a-411e-41f4-bed7-3510fc086644', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a911a555-6150-4bb8-8655-92af9d629aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:29 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Volume volume-b15be78a-411e-41f4-bed7-3510fc086644 (b15be78a-411e-41f4-bed7-3510fc086644): created successfully Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a911a555-6150-4bb8-8655-92af9d629aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Flow 'volume_create_manager' (ccfede36-214f-4a7b-8353-3110e1e4efd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0c50302e-9d4f-4368-b99f-4fe0fccfc228 tempest-ServersNegativeTestJSON-1671584495 None] Created volume successfully. Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Acquiring lock "cinder-quobyte-7a57d132-9821-4151-8f48-1d34f0c9f261" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Lock "cinder-quobyte-7a57d132-9821-4151-8f48-1d34f0c9f261" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Acquiring lock "cinder-quobyte-e94909d7-02c9-4fd0-a319-2a3de6754a4e" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Lock "cinder-quobyte-e94909d7-02c9-4fd0-a319-2a3de6754a4e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Deleting offline snapshot e94909d7-02c9-4fd0-a319-2a3de6754a4e of volume 7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] snapshot_file for this snap is: volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa188d-7a9e-4c23-a421-ae0bcfcc95dd]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:30 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e Nov 05 22:17:30 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:30 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e" returned: 0 in 0.571s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a57d132-9821-4151-8f48-1d34f0c9f261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:17:30 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c54876-f8c7-4636-97fb-5203f0a017cd]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:30 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 Nov 05 22:17:30 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:31 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261" returned: 0 in 0.556s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:31 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e Nov 05 22:17:31 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "cinder-b15be78a-411e-41f4-bed7-3510fc086644-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-b15be78a-411e-41f4-bed7-3510fc086644-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "cinder-quobyte-b15be78a-411e-41f4-bed7-3510fc086644" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-quobyte-b15be78a-411e-41f4-bed7-3510fc086644" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd3f5c-3cb1-4081-9784-ca2b79768c4d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:31 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e" returned: 0 in 0.550s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:31 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 Nov 05 22:17:31 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:31 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e Nov 05 22:17:31 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:32 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261.e94909d7-02c9-4fd0-a319-2a3de6754a4e" returned: 0 in 0.337s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Lock "cinder-quobyte-e94909d7-02c9-4fd0-a319-2a3de6754a4e" released by "_delete_snapshot" :: held 2.224s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:32 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644" returned: 0 in 0.544s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Lock "cinder-quobyte-7a57d132-9821-4151-8f48-1d34f0c9f261" released by "delete_snapshot" :: held 2.260s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:32 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644 Nov 05 22:17:32 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:32 devstack cinder-volume[87085]: WARNING cinder.quota [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1973069369 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1973069369, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:32 devstack cinder-volume[87085]: WARNING cinder.quota [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1973069369 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1973069369, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] Created reservations ['8fe09778-39f9-47c2-8577-c381aae4cd98', '515cc8e2-7431-4fb2-973b-fb7a0b96fc9f', 'df3b5f3b-0cdd-48a3-861f-0684a5239749', '83de7827-d6ff-40c5-9169-d0759d86ab88'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f40a2f20-0169-45bc-a48b-c545b7ebaa7b tempest-GroupSnapshotsV319Test-1289556892 None] group_snapshot b6c53d2c-bb5a-4ee0-9a6a-13ed22529f5a: deleted successfully Nov 05 22:17:32 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b15be78a-411e-41f4-bed7-3510fc086644" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-quobyte-b15be78a-411e-41f4-bed7-3510fc086644" released by "delete_volume" :: held 0.975s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Created reservations ['071bd3dd-e1f1-4753-a53e-0dc7c8d46068', '11fe2450-ca0a-416d-b733-bfd2d158373c', 'e6d7cb70-fe1d-4fc5-8a39-095884196ae2', '27e1fe6d-6225-489a-bb7a-42b80ed53368'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:32 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:32 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:32 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.297s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Deleted volume successfully. Nov 05 22:17:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-18edceb4-7cc5-4bf9-8be4-b6472b4634ae tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-b15be78a-411e-41f4-bed7-3510fc086644-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Acquiring lock "cinder-quobyte-7a57d132-9821-4151-8f48-1d34f0c9f261" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Lock "cinder-quobyte-7a57d132-9821-4151-8f48-1d34f0c9f261" acquired by "delete_volume" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "cinder-eda24308-1c46-4866-84ab-14798283a84d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b5c3d-8809-485c-96c8-1c4b0f49bb0e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-eda24308-1c46-4866-84ab-14798283a84d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:34 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 Nov 05 22:17:34 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "cinder-quobyte-eda24308-1c46-4866-84ab-14798283a84d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-quobyte-eda24308-1c46-4866-84ab-14798283a84d" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8703b4c-0ce7-44fe-bd80-b67662cdb079]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:34 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d Nov 05 22:17:34 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:34 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261" returned: 0 in 0.506s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:34 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261 Nov 05 22:17:34 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:34 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:34 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d" returned: 0 in 0.519s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a57d132-9821-4151-8f48-1d34f0c9f261" returned: 0 in 0.298s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:34 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d Nov 05 22:17:34 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Lock "cinder-quobyte-7a57d132-9821-4151-8f48-1d34f0c9f261" released by "delete_volume" :: held 0.995s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Created reservations ['6bc0d046-b7d2-41bc-baed-b354c7a166b3'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:34 devstack cinder-volume[87085]: WARNING cinder.quota [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1973069369 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1973069369, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Created reservations ['48402743-f5c7-4a8c-82c9-e35d819cc100', '3e1665b1-e038-442f-910e-788d0a19e293', '1a58e612-4094-4f39-a066-bb4ee49aeff9', 'fe7f9d6d-cd85-4617-9b2f-c65b707cee19'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:35 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-eda24308-1c46-4866-84ab-14798283a84d" returned: 0 in 0.418s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-quobyte-eda24308-1c46-4866-84ab-14798283a84d" released by "delete_volume" :: held 1.017s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:35 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:35 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Created reservations ['c4a3d0eb-e4c1-41ac-bbb8-4beab5c1febc', 'bee6e502-6a13-4ba1-8dbf-dec17b226d39', '6bbd5113-e3bc-4ad2-961a-d7fdffa1024c', '245247b3-dd7c-43b3-bfcc-ce4630ab4227'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:35 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:35 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:35 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.354s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-09c8938a-f536-47ae-8eae-a7838dbf884c tempest-GroupSnapshotsV319Test-1289556892 None] Delete group completed successfully. Nov 05 22:17:35 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.356s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Deleted volume successfully. Nov 05 22:17:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3e988140-048e-4df2-a4b0-7848c8169251 tempest-ServersNegativeTestJSON-1671584495 None] Lock "cinder-eda24308-1c46-4866-84ab-14798283a84d-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:40 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:40 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:40 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.332s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 8 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:17:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:17:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8d887381-6316-4ab4-8f12-503be6319a5a tempest-GroupsTest-367812157 None] Group tempest-Group1-85672454: creating Nov 05 22:17:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8d887381-6316-4ab4-8f12-503be6319a5a tempest-GroupsTest-367812157 None] Group tempest-Group1-85672454: created successfully Nov 05 22:17:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8d887381-6316-4ab4-8f12-503be6319a5a tempest-GroupsTest-367812157 None] Create group completed successfully. Nov 05 22:17:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7ff5c8c1-98f3-45fe-bb87-fa46a78edb33 tempest-GroupsTest-367812157 None] Group tempest-Group2-189767590: creating Nov 05 22:17:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7ff5c8c1-98f3-45fe-bb87-fa46a78edb33 tempest-GroupsTest-367812157 None] Group tempest-Group2-189767590: created successfully Nov 05 22:17:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7ff5c8c1-98f3-45fe-bb87-fa46a78edb33 tempest-GroupsTest-367812157 None] Create group completed successfully. Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Flow 'volume_create_manager' (ec6765a0-0361-4297-9ee9-91ee77b8c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20c3c1e-3368-456e-b8f9-008aa5d727f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20c3c1e-3368-456e-b8f9-008aa5d727f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1977035371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9db02ef-1944-49d7-9683-2cb5749f798a,host='devstack@QuobyteHD#QuobyteHD',id=d58e16ff-8129-406f-a352-ec352887d973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f3412c26e94f4db2e8a6e39218c06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:44Z,use_quota=True,user_id='ba53c367a188453698866106c632db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea6229ba-d7ea-4925-b50d-68159cffecef),volume_type_id=ea6229ba-d7ea-4925-b50d-68159cffecef)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08320ee6-30df-4012-ab86-f35ba79419a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08320ee6-30df-4012-ab86-f35ba79419a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46da4171-f630-4b96-ae5b-a3078ab9411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46da4171-f630-4b96-ae5b-a3078ab9411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58e16ff-8129-406f-a352-ec352887d973', 'volume_name': 'volume-d58e16ff-8129-406f-a352-ec352887d973', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e5204-878e-46ad-81d2-06d5d61dfd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458e5204-878e-46ad-81d2-06d5d61dfd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b205b3b7-e8be-4388-9667-154dca5b05f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:43 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Volume d58e16ff-8129-406f-a352-ec352887d973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58e16ff-8129-406f-a352-ec352887d973', 'volume_size': 1} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e9db02ef-1944-49d7-9683-2cb5749f798a,created_at=2026-11-05T21:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1977035371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e9db02ef-1944-49d7-9683-2cb5749f798a,host='devstack@QuobyteHD#QuobyteHD',id=d58e16ff-8129-406f-a352-ec352887d973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f3412c26e94f4db2e8a6e39218c06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:44Z,use_quota=True,user_id='ba53c367a188453698866106c632db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea6229ba-d7ea-4925-b50d-68159cffecef),volume_type_id=ea6229ba-d7ea-4925-b50d-68159cffecef)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Creating volume d58e16ff-8129-406f-a352-ec352887d973 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:43 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:44 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 1073741824 Nov 05 22:17:44 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:45 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 1073741824" returned: 0 in 1.181s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:45 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 Nov 05 22:17:45 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:45 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973" returned: 0 in 0.629s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b205b3b7-e8be-4388-9667-154dca5b05f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58e16ff-8129-406f-a352-ec352887d973', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57d6f71-3594-4793-85dc-837b7e102303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:45 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Volume volume-d58e16ff-8129-406f-a352-ec352887d973 (d58e16ff-8129-406f-a352-ec352887d973): created successfully Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57d6f71-3594-4793-85dc-837b7e102303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:45 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Flow 'volume_create_manager' (ec6765a0-0361-4297-9ee9-91ee77b8c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:46 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-aefc6a1c-77d8-494f-8eae-75597ecd065d tempest-GroupsTest-367812157 None] Created volume successfully. Nov 05 22:17:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Acquiring lock "cinder-quobyte-d58e16ff-8129-406f-a352-ec352887d973" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Lock "cinder-quobyte-d58e16ff-8129-406f-a352-ec352887d973" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:48 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c6851d-0207-425a-b877-427f6e4a3827]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:48 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 Nov 05 22:17:48 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:48 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973" returned: 0 in 0.834s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:48 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973 Nov 05 22:17:48 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:49 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58e16ff-8129-406f-a352-ec352887d973" returned: 0 in 0.429s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Lock "cinder-quobyte-d58e16ff-8129-406f-a352-ec352887d973" released by "delete_volume" :: held 1.350s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Created reservations ['d3dda61e-d5e5-43b4-8283-14e9489caacb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:49 devstack cinder-volume[87085]: WARNING cinder.quota [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-432431869 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-432431869, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:49 devstack cinder-volume[87085]: WARNING cinder.quota [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-432431869 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-432431869, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Created reservations ['ea953484-74d9-4625-9534-013171176d13', '4f740713-2f2d-4f77-9c1a-3d5f05434121', '0dce84af-0d27-4518-b1d6-d63e9429c54e', '43e49a17-2a78-48ae-a437-8eaccfcc30a4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Flow 'volume_create_manager' (09349f12-9ba4-4f4f-9438-ca79445f1ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e37c59d-be4b-4a2e-a475-7bf511819f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e37c59d-be4b-4a2e-a475-7bf511819f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1282054565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852125ab-820f-43c4-8c15-ef9aa4fa6a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6db366273f430d91eb758d3bba98db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:50Z,use_quota=True,user_id='59c4246a59c54ecfafd3cede36962e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b79814-bc50-4f2f-868a-4537d8907d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b79814-bc50-4f2f-868a-4537d8907d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8e3a0b-8547-4050-aa2a-47f92037895c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8e3a0b-8547-4050-aa2a-47f92037895c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852125ab-820f-43c4-8c15-ef9aa4fa6a5d', 'volume_name': 'volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971e4d81-cce1-4402-9f5e-5011c12d1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (971e4d81-cce1-4402-9f5e-5011c12d1fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05184e61-3e47-43ce-83a2-40ef4f1b2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Volume 852125ab-820f-43c4-8c15-ef9aa4fa6a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d', 'volume_size': 1} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1282054565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852125ab-820f-43c4-8c15-ef9aa4fa6a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6db366273f430d91eb758d3bba98db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:50Z,use_quota=True,user_id='59c4246a59c54ecfafd3cede36962e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Creating volume 852125ab-820f-43c4-8c15-ef9aa4fa6a5d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:49 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:49 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d 1073741824 Nov 05 22:17:49 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:50 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:50 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:50 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.493s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a0b949db-fa18-45bd-8f36-3693be8123f4 tempest-GroupsTest-367812157 None] Delete group completed successfully. Nov 05 22:17:50 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d 1073741824" returned: 0 in 0.690s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:50 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d Nov 05 22:17:50 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Created reservations ['e4e4697d-2d9b-4755-845b-c66542d2db8b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:50 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:17:50 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:51 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05184e61-3e47-43ce-83a2-40ef4f1b2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666b867c-ed66-41c3-9a1a-679ecfae9643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Volume volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d (852125ab-820f-43c4-8c15-ef9aa4fa6a5d): created successfully Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666b867c-ed66-41c3-9a1a-679ecfae9643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Flow 'volume_create_manager' (09349f12-9ba4-4f4f-9438-ca79445f1ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c52e80d1-5988-400f-975f-9ed465e2a701 tempest-DeleteServersTestJSON-885691827 None] Created volume successfully. Nov 05 22:17:51 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.453s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:51 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:17:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3002cdba-ebb4-4aff-8938-7b3b06f9c26d tempest-GroupsTest-367812157 None] Delete group completed successfully. Nov 05 22:17:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-942c8435-91c9-4cfc-bed0-a8bcce35f7ac tempest-GroupsTest-367812157 None] Group tempest-GroupsTest-Group-1047638151: creating Nov 05 22:17:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-942c8435-91c9-4cfc-bed0-a8bcce35f7ac tempest-GroupsTest-367812157 None] Group tempest-GroupsTest-Group-1047638151: created successfully Nov 05 22:17:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-942c8435-91c9-4cfc-bed0-a8bcce35f7ac tempest-GroupsTest-367812157 None] Create group completed successfully. Nov 05 22:17:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b758a0ed-fdd3-4084-9e05-0a685acffe0a req-74202b9d-24d0-4af0-b55e-9baa9aa53582 tempest-DeleteServersTestJSON-885691827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b758a0ed-fdd3-4084-9e05-0a685acffe0a req-74202b9d-24d0-4af0-b55e-9baa9aa53582 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b758a0ed-fdd3-4084-9e05-0a685acffe0a req-74202b9d-24d0-4af0-b55e-9baa9aa53582 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b758a0ed-fdd3-4084-9e05-0a685acffe0a req-74202b9d-24d0-4af0-b55e-9baa9aa53582 tempest-DeleteServersTestJSON-885691827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4f23a1a-be1d-4ab4-83b3-bfe95a5f9832', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:17:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-b758a0ed-fdd3-4084-9e05-0a685acffe0a req-74202b9d-24d0-4af0-b55e-9baa9aa53582 tempest-DeleteServersTestJSON-885691827 None] attachment_update completed successfully. Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Flow 'volume_create_manager' (b86b5d3a-1bc9-467a-878b-14ed8477ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dfb3cc-7ea1-4282-9a46-b8c0d297df79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dfb3cc-7ea1-4282-9a46-b8c0d297df79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-169726963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e28c573-c6bd-4730-b8cd-ad757ff33113,host='devstack@QuobyteHD#QuobyteHD',id=0db0de78-dd5d-4de6-ac02-771af8a57cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f3412c26e94f4db2e8a6e39218c06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:55Z,use_quota=True,user_id='ba53c367a188453698866106c632db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d3a526b-d996-4fe9-a200-dc2b780aa46b),volume_type_id=7d3a526b-d996-4fe9-a200-dc2b780aa46b)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe9ee2-57ff-41f7-8f92-106f314615da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe9ee2-57ff-41f7-8f92-106f314615da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd92693-2351-41ce-9767-38de7d1e13c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd92693-2351-41ce-9767-38de7d1e13c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db0de78-dd5d-4de6-ac02-771af8a57cf1', 'volume_name': 'volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27561c95-1122-4895-aaaf-2cea8c4241fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27561c95-1122-4895-aaaf-2cea8c4241fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d508b6af-d87f-49da-b95e-a5b30ddcbc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Volume 0db0de78-dd5d-4de6-ac02-771af8a57cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1', 'volume_size': 1} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e28c573-c6bd-4730-b8cd-ad757ff33113,created_at=2026-11-05T21:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-169726963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e28c573-c6bd-4730-b8cd-ad757ff33113,host='devstack@QuobyteHD#QuobyteHD',id=0db0de78-dd5d-4de6-ac02-771af8a57cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f3412c26e94f4db2e8a6e39218c06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:55Z,use_quota=True,user_id='ba53c367a188453698866106c632db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d3a526b-d996-4fe9-a200-dc2b780aa46b),volume_type_id=7d3a526b-d996-4fe9-a200-dc2b780aa46b)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Creating volume 0db0de78-dd5d-4de6-ac02-771af8a57cf1 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:55 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:55 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 1073741824 Nov 05 22:17:55 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:56 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 1073741824" returned: 0 in 0.618s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:56 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 Nov 05 22:17:56 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:56 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1" returned: 0 in 0.577s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d508b6af-d87f-49da-b95e-a5b30ddcbc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fda4b6-8655-4432-bf19-5e614c1983d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:56 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Volume volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 (0db0de78-dd5d-4de6-ac02-771af8a57cf1): created successfully Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fda4b6-8655-4432-bf19-5e614c1983d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Flow 'volume_create_manager' (b86b5d3a-1bc9-467a-878b-14ed8477ea48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:56 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-eedc6d71-068d-42c5-a038-f8972c83dfa8 tempest-GroupsTest-367812157 None] Created volume successfully. Nov 05 22:17:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-9ff20880-51ca-440b-bd94-5a4a5b97fd02 req-6fe5e85e-ec5d-47a2-8699-8dcae394532c tempest-DeleteServersTestJSON-885691827 None] Terminate volume connection completed successfully. Nov 05 22:17:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-9ff20880-51ca-440b-bd94-5a4a5b97fd02 req-6fe5e85e-ec5d-47a2-8699-8dcae394532c tempest-DeleteServersTestJSON-885691827 None] Deleting attachment a4f23a1a-be1d-4ab4-83b3-bfe95a5f9832. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Flow 'volume_create_manager' (2749a4fc-1295-43de-a388-b2159c9d5318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50b8eb6-7943-445c-965a-a1586e8e9d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50b8eb6-7943-445c-965a-a1586e8e9d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241927907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e28c573-c6bd-4730-b8cd-ad757ff33113,host='devstack@QuobyteHD#QuobyteHD',id=da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f3412c26e94f4db2e8a6e39218c06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:59Z,use_quota=True,user_id='ba53c367a188453698866106c632db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d3a526b-d996-4fe9-a200-dc2b780aa46b),volume_type_id=7d3a526b-d996-4fe9-a200-dc2b780aa46b)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405ce168-86e8-47b4-8148-34b10e2b13aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (405ce168-86e8-47b4-8148-34b10e2b13aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8029bda3-e866-4696-912e-87878591a502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8029bda3-e866-4696-912e-87878591a502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2', 'volume_name': 'volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6c1ba4-3673-4b0d-8ee8-d15e69a62e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6c1ba4-3673-4b0d-8ee8-d15e69a62e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abdc51f-bdc6-406b-a568-51e7c571772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:58 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Volume da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2', 'volume_size': 1} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e28c573-c6bd-4730-b8cd-ad757ff33113,created_at=2026-11-05T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1241927907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e28c573-c6bd-4730-b8cd-ad757ff33113,host='devstack@QuobyteHD#QuobyteHD',id=da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f3412c26e94f4db2e8a6e39218c06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:17:59Z,use_quota=True,user_id='ba53c367a188453698866106c632db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d3a526b-d996-4fe9-a200-dc2b780aa46b),volume_type_id=7d3a526b-d996-4fe9-a200-dc2b780aa46b)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Creating volume da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:17:58 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:17:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:58 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 1073741824 Nov 05 22:17:58 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Acquiring lock "cinder-852125ab-820f-43c4-8c15-ef9aa4fa6a5d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Lock "cinder-852125ab-820f-43c4-8c15-ef9aa4fa6a5d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Acquiring lock "cinder-quobyte-852125ab-820f-43c4-8c15-ef9aa4fa6a5d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Lock "cinder-quobyte-852125ab-820f-43c4-8c15-ef9aa4fa6a5d" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aacb03c-b581-41da-8d86-b93953408a28]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:59 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d Nov 05 22:17:59 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:59 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 1073741824" returned: 0 in 0.638s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:59 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 Nov 05 22:17:59 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:59 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d" returned: 0 in 0.529s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:17:59 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d Nov 05 22:17:59 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:17:59 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abdc51f-bdc6-406b-a568-51e7c571772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:17:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6806fc7-f723-43cf-b845-c6a3761eeefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:17:59 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Volume volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 (da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2): created successfully Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6806fc7-f723-43cf-b845-c6a3761eeefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Flow 'volume_create_manager' (2749a4fc-1295-43de-a388-b2159c9d5318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1fed7c0a-d667-40b1-9f80-5a0bf301cdbb tempest-GroupsTest-367812157 None] Created volume successfully. Nov 05 22:18:00 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-852125ab-820f-43c4-8c15-ef9aa4fa6a5d" returned: 0 in 0.324s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Lock "cinder-quobyte-852125ab-820f-43c4-8c15-ef9aa4fa6a5d" released by "delete_volume" :: held 0.926s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Created reservations ['ff1563cd-5657-4660-a7be-34829e698023', '0be8b580-0c94-4b4d-a566-9cd471be823d', '99e3df2c-b469-4c40-9b60-f304721fd475', '125fa403-0285-446f-9a7f-43971a19f581'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d615a402-b553-4134-af77-ed47be81d45a tempest-GroupsTest-367812157 None] Update group completed successfully. Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:00 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:18:00 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:00 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.325s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Deleted volume successfully. Nov 05 22:18:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48970e8c-8938-4be4-b253-a30440c06530 tempest-DeleteServersTestJSON-885691827 None] Lock "cinder-852125ab-820f-43c4-8c15-ef9aa4fa6a5d-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d1a3117a-fc57-434c-999c-0a7d0680d371 tempest-GroupsTest-367812157 None] Update group completed successfully. Nov 05 22:18:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Acquiring lock "cinder-quobyte-0db0de78-dd5d-4de6-ac02-771af8a57cf1" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Lock "cinder-quobyte-0db0de78-dd5d-4de6-ac02-771af8a57cf1" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca5126-6bb5-4604-b157-1af41f9edee5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:04 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 Nov 05 22:18:04 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:04 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1" returned: 0 in 0.473s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:04 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1 Nov 05 22:18:04 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:04 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0db0de78-dd5d-4de6-ac02-771af8a57cf1" returned: 0 in 0.326s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Lock "cinder-quobyte-0db0de78-dd5d-4de6-ac02-771af8a57cf1" released by "delete_volume" :: held 0.871s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Acquiring lock "cinder-quobyte-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Lock "cinder-quobyte-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6022fc-c21d-4523-a869-9b426c36fd88]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:04 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 Nov 05 22:18:04 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:05 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2" returned: 0 in 0.467s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:05 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2 Nov 05 22:18:05 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:05 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Lock "cinder-quobyte-da3d15ff-9c8b-4e4e-8fdd-8a4942e2dcd2" released by "delete_volume" :: held 0.848s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:05 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Created reservations ['9bbc5a71-0760-4369-857b-da62a59c514b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:05 devstack cinder-volume[87085]: WARNING cinder.quota [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1730990456 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1730990456, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:18:05 devstack cinder-volume[87085]: WARNING cinder.quota [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1730990456 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1730990456, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:18:05 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Created reservations ['b2bbe42d-ef27-41ff-9781-4b9b56a5a984', '4259ed49-9380-4940-86fd-cdc30cfdfa1d', '5b31c457-a0ac-46dd-adbe-0b298e2f6909', 'ef47422e-9ee4-401d-9008-4c7b84b2ce1a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:05 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Created reservations ['a5d1ab57-7882-4cba-8d03-90deacb5da28', '8ec7618e-5341-4127-ac55-6df444e6bb33', '5ff38f7b-362b-4628-8118-b0d0ecf8ebd4', 'b001711f-eaa5-43f7-b8c9-3056202dcfda'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:06 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:18:06 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:06 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.371s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:06 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2afe907f-3a5b-4901-9aa7-f23650b77b11 tempest-GroupsTest-367812157 None] Delete group completed successfully. Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=115,cinder:UPDATE=130,cinder:INSERT=29,cinder:DELETE=6 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Flow 'volume_create_manager' (e1e6d47c-c02a-4eac-93c2-f0de7d4fedc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0144ca60-17ea-4eee-8c24-2cb20069dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0144ca60-17ea-4eee-8c24-2cb20069dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-585062528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc25cf8-fea0-4f79-8d95-60f3b2b0791e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc49123179044a88b6d9b5d0f26a636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:09Z,use_quota=True,user_id='0371557040ae454cbe26004895757da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(493c9374-308e-4cd7-b084-8c89af81f411),volume_type_id=493c9374-308e-4cd7-b084-8c89af81f411)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba35069-a7a7-47f0-9fbe-6161164f5d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba35069-a7a7-47f0-9fbe-6161164f5d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa77ee36-babc-4d3e-9492-55f22505bade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa77ee36-babc-4d3e-9492-55f22505bade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc25cf8-fea0-4f79-8d95-60f3b2b0791e', 'volume_name': 'volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cf9a22-c850-4e49-90f7-f4c3a3f9e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cf9a22-c850-4e49-90f7-f4c3a3f9e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfff394-00cb-4a00-8e24-e2625092b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:09 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Volume dbc25cf8-fea0-4f79-8d95-60f3b2b0791e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e', 'volume_size': 1} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-585062528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc25cf8-fea0-4f79-8d95-60f3b2b0791e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc49123179044a88b6d9b5d0f26a636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:09Z,use_quota=True,user_id='0371557040ae454cbe26004895757da2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(493c9374-308e-4cd7-b084-8c89af81f411),volume_type_id=493c9374-308e-4cd7-b084-8c89af81f411)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Creating volume dbc25cf8-fea0-4f79-8d95-60f3b2b0791e {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:09 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:18:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:09 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e 1073741824 Nov 05 22:18:09 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:10 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e 1073741824" returned: 0 in 0.658s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:10 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e Nov 05 22:18:10 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:10 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e" returned: 0 in 0.371s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfff394-00cb-4a00-8e24-e2625092b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1e4f3f-c08d-4d14-82e5-5d0232b38765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Volume volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e (dbc25cf8-fea0-4f79-8d95-60f3b2b0791e): created successfully Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1e4f3f-c08d-4d14-82e5-5d0232b38765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Flow 'volume_create_manager' (e1e6d47c-c02a-4eac-93c2-f0de7d4fedc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-62f86f79-a979-49e7-b7d2-9454d9f9f285 tempest-VolumeTypesAccessTest-2018798729 None] Created volume successfully. Nov 05 22:18:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Acquiring lock "cinder-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Lock "cinder-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Acquiring lock "cinder-quobyte-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Lock "cinder-quobyte-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:11 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b72e7-1991-4e6b-be14-39149c3baaf0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:12 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e Nov 05 22:18:12 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:12 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e" returned: 0 in 0.703s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:12 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e Nov 05 22:18:12 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:13 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e" returned: 0 in 0.483s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Lock "cinder-quobyte-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e" released by "delete_volume" :: held 1.267s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:13 devstack cinder-volume[87085]: WARNING cinder.quota [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-997579021 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-997579021, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:18:13 devstack cinder-volume[87085]: WARNING cinder.quota [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-997579021 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-997579021, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Created reservations ['18af3e92-daa2-4cb4-bf87-8ebf84d7a8ff', '3f1d14d1-c2bd-4873-8718-32fe09a44b77', '602889cb-8e31-4ec3-84b0-962561bb05a8', 'da0c087e-b1e8-49d5-b8fc-aced3bece166'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:13 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:18:13 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:13 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Deleted volume successfully. Nov 05 22:18:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-73a7d3a6-9545-4b73-99e4-a11059507024 tempest-VolumeTypesAccessTest-2018798729 None] Lock "cinder-dbc25cf8-fea0-4f79-8d95-60f3b2b0791e-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:23 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=109,cinder:UPDATE=131,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:18:23 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Flow 'volume_create_manager' (1a4c55b4-305d-4b34-9399-962b41f3314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea82a89-33b8-4338-9a45-c479a40cd1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea82a89-33b8-4338-9a45-c479a40cd1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1972852520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e91ec63-14a8-487d-8a7e-84c755ea7fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea05551a5843b4bc6f132a841d630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:36Z,use_quota=True,user_id='dd1be744d54040d7994f4ea906921fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce76919-9815-48f1-85a8-e2c0a390d00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce76919-9815-48f1-85a8-e2c0a390d00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd977b3d-4355-445d-ae3c-c45d2ea9199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd977b3d-4355-445d-ae3c-c45d2ea9199f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e91ec63-14a8-487d-8a7e-84c755ea7fd8', 'volume_name': 'volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe2b7fd-1314-4237-804a-9cfbd5ec7856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe2b7fd-1314-4237-804a-9cfbd5ec7856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b953bdad-2cad-4cb5-9e1a-3e395e8cd447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Volume 4e91ec63-14a8-487d-8a7e-84c755ea7fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8', 'volume_size': 1} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1972852520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e91ec63-14a8-487d-8a7e-84c755ea7fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fea05551a5843b4bc6f132a841d630a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:36Z,use_quota=True,user_id='dd1be744d54040d7994f4ea906921fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Creating volume 4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:35 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:18:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:35 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 1073741824 Nov 05 22:18:35 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:36 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 1073741824" returned: 0 in 0.569s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:36 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 Nov 05 22:18:36 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:36 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" returned: 0 in 0.373s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b953bdad-2cad-4cb5-9e1a-3e395e8cd447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d359b607-7006-4980-b1f2-3b43a07e3a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Volume volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 (4e91ec63-14a8-487d-8a7e-84c755ea7fd8): created successfully Nov 05 22:18:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d359b607-7006-4980-b1f2-3b43a07e3a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Flow 'volume_create_manager' (1a4c55b4-305d-4b34-9399-962b41f3314a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e3282463-5f41-4a7e-9eef-559e061fc943 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Created volume successfully. Nov 05 22:18:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Creating offline snapshot 3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 of volume 4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:18:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f640f5c-f434-4a3f-8d9c-bb1a2bd73362]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:39 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 Nov 05 22:18:39 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:39 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" returned: 0 in 0.784s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:39 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 1G Nov 05 22:18:39 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:40 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:18:40 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:40 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 1G" returned: 0 in 0.746s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:40 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 Nov 05 22:18:40 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:40 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.499s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 8 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:18:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:18:41 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" returned: 0 in 0.632s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:41 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 is being set with open permissions: ugo+rw Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:41 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 Nov 05 22:18:41 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Flow 'volume_create_manager' (540363d4-f386-437d-bd8d-e1a00c021622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fe1bb8-a444-49c6-8810-54889232d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67fe1bb8-a444-49c6-8810-54889232d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-931939691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea721ff-72d0-410b-8413-84bc9bb63ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34aded1f0ee045b782aa9a85eab172d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:41Z,use_quota=True,user_id='cbb9e7a150ea4433be12238b08158273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90698f23-d2a2-49b7-a0bd-8ebbe76286e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90698f23-d2a2-49b7-a0bd-8ebbe76286e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:41 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea636cf-409f-40bb-bec9-d2c1b17619b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea636cf-409f-40bb-bec9-d2c1b17619b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea721ff-72d0-410b-8413-84bc9bb63ea7', 'volume_name': 'volume-aea721ff-72d0-410b-8413-84bc9bb63ea7', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832560b0-6b00-4b1b-955c-6ac8b0507b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832560b0-6b00-4b1b-955c-6ac8b0507b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1d2fb7-b148-46ab-ae1b-46fcb3136dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:41 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Volume aea721ff-72d0-410b-8413-84bc9bb63ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea721ff-72d0-410b-8413-84bc9bb63ea7', 'volume_size': 1} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" returned: 0 in 0.503s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:41 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.info Nov 05 22:18:41 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:42 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.info" returned: 0 in 0.447s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:42 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.info is being set with open permissions: ugo+rw Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:42 devstack sudo[91567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.info Nov 05 22:18:42 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:42 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.info" returned: 0 in 0.360s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.658s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-931939691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea721ff-72d0-410b-8413-84bc9bb63ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34aded1f0ee045b782aa9a85eab172d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:41Z,use_quota=True,user_id='cbb9e7a150ea4433be12238b08158273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Creating volume aea721ff-72d0-410b-8413-84bc9bb63ea7 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:42 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:18:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:42 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 1073741824 Nov 05 22:18:42 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-50b8611a-b73c-4390-a494-b577cb23578b tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Create snapshot completed successfully Nov 05 22:18:43 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 1073741824" returned: 0 in 0.806s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:43 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 Nov 05 22:18:43 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:43 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7" returned: 0 in 0.444s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f1d2fb7-b148-46ab-ae1b-46fcb3136dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea721ff-72d0-410b-8413-84bc9bb63ea7', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968ba739-81aa-47a5-8619-18bfd57cadb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:43 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Volume volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 (aea721ff-72d0-410b-8413-84bc9bb63ea7): created successfully Nov 05 22:18:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968ba739-81aa-47a5-8619-18bfd57cadb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Flow 'volume_create_manager' (540363d4-f386-437d-bd8d-e1a00c021622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "cinder-3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:44 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7d7d295b-e5e7-4498-8422-27012e1518d0 tempest-AttachVolumeTestJSON-1488034404 None] Created volume successfully. Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "cinder-quobyte-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-quobyte-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "cinder-quobyte-3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-quobyte-3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Deleting offline snapshot 3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 of volume 4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] snapshot_file for this snap is: volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb36f48-54a1-411f-bc94-01bce9092715]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:44 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 Nov 05 22:18:44 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:44 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" returned: 0 in 0.422s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dc47f3-9a05-4180-8149-feca68e8fd03]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:44 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 Nov 05 22:18:44 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:45 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" returned: 0 in 0.476s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:45 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 Nov 05 22:18:45 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:45 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" returned: 0 in 0.508s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:45 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8 Nov 05 22:18:45 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:45 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8.3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" returned: 0 in 0.320s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-9e780079-58cf-47d5-814a-016a21a2e161 req-b859f5c9-36ac-42d4-ac73-ece75d3ab806 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-9e780079-58cf-47d5-814a-016a21a2e161 req-b859f5c9-36ac-42d4-ac73-ece75d3ab806 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-quobyte-3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8" released by "_delete_snapshot" :: held 1.888s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-9e780079-58cf-47d5-814a-016a21a2e161 req-b859f5c9-36ac-42d4-ac73-ece75d3ab806 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-quobyte-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" released by "delete_snapshot" :: held 1.918s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-9e780079-58cf-47d5-814a-016a21a2e161 req-b859f5c9-36ac-42d4-ac73-ece75d3ab806 tempest-AttachVolumeTestJSON-1488034404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-aea721ff-72d0-410b-8413-84bc9bb63ea7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04f12135-00d6-46cc-932e-4650a0fa964a', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Created reservations ['cd524968-28af-4043-a427-f67566e510be', 'f852bceb-00f4-418c-866a-e7b09377db2e', '7e97b199-162f-4f5c-a98b-46a66b5bd727', '67341dce-477a-4a82-b53f-5f319ef30c7e'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:46 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-9e780079-58cf-47d5-814a-016a21a2e161 req-b859f5c9-36ac-42d4-ac73-ece75d3ab806 tempest-AttachVolumeTestJSON-1488034404 None] attachment_update completed successfully. Nov 05 22:18:46 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Delete snapshot completed successfully. Nov 05 22:18:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb59f663-9fc7-47d1-8bb4-4bee4c7a2909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-3c87637d-0b1f-41f8-bc9f-15fe1c11a0c8-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "cinder-4e91ec63-14a8-487d-8a7e-84c755ea7fd8-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-4e91ec63-14a8-487d-8a7e-84c755ea7fd8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "cinder-quobyte-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-quobyte-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" acquired by "delete_volume" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ae55a-b07c-43ae-8466-f59bce4c184e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:47 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 Nov 05 22:18:47 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:47 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" returned: 0 in 0.392s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:48 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8 Nov 05 22:18:48 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:48 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" returned: 0 in 0.459s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-quobyte-4e91ec63-14a8-487d-8a7e-84c755ea7fd8" released by "delete_volume" :: held 1.001s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Created reservations ['56aa1d34-dd82-47a2-b13b-ae3e62984ef1', '4a7bc2d6-dfe7-4b2d-bb4a-917ed899b104', '0284eb37-a48a-4cc2-81cd-936d2c24346b', 'c159dc8f-c321-4be4-aa71-4e03943e1daa'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:48 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:18:48 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:48 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.269s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:48 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:18:48 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Deleted volume successfully. Nov 05 22:18:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b962e74-3531-4a64-830a-ef2b35eaf37c tempest-VolumeSnapshotQuotasNegativeTestJSON-1707906982 None] Lock "cinder-4e91ec63-14a8-487d-8a7e-84c755ea7fd8-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Flow 'volume_create_manager' (2b772a65-e2f0-40dd-b5cd-cc60a57b9dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbfc688-9d51-43b0-ba45-211797489234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbfc688-9d51-43b0-ba45-211797489234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756373771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00df58f1-9596-4b47-9774-a40af5af425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a64ddd68204bd68509470e6410c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:53Z,use_quota=True,user_id='0c7fca871c614aab9c77100e55144671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea609ac-7605-4e04-8749-57458c14ac56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea609ac-7605-4e04-8749-57458c14ac56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0f4d54-7238-4787-a529-7c7956121b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b0f4d54-7238-4787-a529-7c7956121b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00df58f1-9596-4b47-9774-a40af5af425e', 'volume_name': 'volume-00df58f1-9596-4b47-9774-a40af5af425e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee81d93f-1f0a-4fdf-b23b-dd092acae754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee81d93f-1f0a-4fdf-b23b-dd092acae754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98054ace-3065-408e-8ff7-866488c00426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:52 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Volume 00df58f1-9596-4b47-9774-a40af5af425e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00df58f1-9596-4b47-9774-a40af5af425e', 'volume_size': 1} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756373771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00df58f1-9596-4b47-9774-a40af5af425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a64ddd68204bd68509470e6410c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:53Z,use_quota=True,user_id='0c7fca871c614aab9c77100e55144671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Creating volume 00df58f1-9596-4b47-9774-a40af5af425e {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:52 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:18:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:52 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e 1073741824 Nov 05 22:18:52 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:53 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e 1073741824" returned: 0 in 0.739s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:53 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e Nov 05 22:18:53 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:54 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e" returned: 0 in 0.521s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98054ace-3065-408e-8ff7-866488c00426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00df58f1-9596-4b47-9774-a40af5af425e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1955e622-9e35-454e-9080-3c0d13e5410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Volume volume-00df58f1-9596-4b47-9774-a40af5af425e (00df58f1-9596-4b47-9774-a40af5af425e): created successfully Nov 05 22:18:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1955e622-9e35-454e-9080-3c0d13e5410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Flow 'volume_create_manager' (2b772a65-e2f0-40dd-b5cd-cc60a57b9dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-372b33d9-122a-4b4f-bca4-b269cc718e34 tempest-VolumesListAdminTestJSON-1125018088 None] Created volume successfully. Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Flow 'volume_create_manager' (0495efd1-02c7-4e64-9d7f-b34fc9896b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2352cdd-f99f-4cf2-af98-90c89b613d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2352cdd-f99f-4cf2-af98-90c89b613d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1839701187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d0bd94-8c87-42bd-8402-3468d56daaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a64ddd68204bd68509470e6410c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:56Z,use_quota=True,user_id='0c7fca871c614aab9c77100e55144671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd5d295-4ffe-4d46-b864-1715fd5d768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd5d295-4ffe-4d46-b864-1715fd5d768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e70eaa-8cf9-4c6f-a2bc-e687d3f7e8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e70eaa-8cf9-4c6f-a2bc-e687d3f7e8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d0bd94-8c87-42bd-8402-3468d56daaa6', 'volume_name': 'volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b843951-fa11-4ca7-9e02-77919b5fb596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b843951-fa11-4ca7-9e02-77919b5fb596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8899fe1b-1912-413b-88a5-1236106adda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Volume b0d0bd94-8c87-42bd-8402-3468d56daaa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6', 'volume_size': 1} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1839701187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d0bd94-8c87-42bd-8402-3468d56daaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a64ddd68204bd68509470e6410c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:56Z,use_quota=True,user_id='0c7fca871c614aab9c77100e55144671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Creating volume b0d0bd94-8c87-42bd-8402-3468d56daaa6 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:55 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:18:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:55 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 1073741824 Nov 05 22:18:55 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:56 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 1073741824" returned: 0 in 0.515s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:56 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 Nov 05 22:18:56 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:56 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8899fe1b-1912-413b-88a5-1236106adda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f367de63-4281-48d7-81e2-9fd7d33f5c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:56 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Volume volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 (b0d0bd94-8c87-42bd-8402-3468d56daaa6): created successfully Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f367de63-4281-48d7-81e2-9fd7d33f5c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Flow 'volume_create_manager' (0495efd1-02c7-4e64-9d7f-b34fc9896b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:56 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-108d66ce-9ed1-4cd9-ae3b-28452c7ca7c9 tempest-VolumesListAdminTestJSON-1125018088 None] Created volume successfully. Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Flow 'volume_create_manager' (53e26809-6e56-474b-bbaf-4f734c6647d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944dd305-6181-45a7-861a-9e6ba866e859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944dd305-6181-45a7-861a-9e6ba866e859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1870472688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7386ff-40f6-402c-af41-925d6bd82ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a64ddd68204bd68509470e6410c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:58Z,use_quota=True,user_id='0c7fca871c614aab9c77100e55144671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe455c2-7a1f-408d-b2ea-cdbcaa20573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe455c2-7a1f-408d-b2ea-cdbcaa20573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79992ad0-3735-4d9d-a485-7624f52dc55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79992ad0-3735-4d9d-a485-7624f52dc55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7386ff-40f6-402c-af41-925d6bd82ac5', 'volume_name': 'volume-2b7386ff-40f6-402c-af41-925d6bd82ac5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821c9bb5-bbf2-482d-b794-844a8f4602f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821c9bb5-bbf2-482d-b794-844a8f4602f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7862c4d2-2567-4ab1-b6ee-83749d5ecf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:58 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Volume 2b7386ff-40f6-402c-af41-925d6bd82ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7386ff-40f6-402c-af41-925d6bd82ac5', 'volume_size': 1} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1870472688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7386ff-40f6-402c-af41-925d6bd82ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a64ddd68204bd68509470e6410c0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:18:58Z,use_quota=True,user_id='0c7fca871c614aab9c77100e55144671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Creating volume 2b7386ff-40f6-402c-af41-925d6bd82ac5 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:18:58 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:18:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:58 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 1073741824 Nov 05 22:18:58 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:59 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 1073741824" returned: 0 in 0.538s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:18:59 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 Nov 05 22:18:59 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:18:59 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5" returned: 0 in 0.396s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7862c4d2-2567-4ab1-b6ee-83749d5ecf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7386ff-40f6-402c-af41-925d6bd82ac5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f37f7e-7961-4072-b66e-a4681fe271a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:18:59 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Volume volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 (2b7386ff-40f6-402c-af41-925d6bd82ac5): created successfully Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f37f7e-7961-4072-b66e-a4681fe271a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:18:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Flow 'volume_create_manager' (53e26809-6e56-474b-bbaf-4f734c6647d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:18:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-deb47c88-2d4a-4239-949d-ee9226f64b39 tempest-VolumesListAdminTestJSON-1125018088 None] Created volume successfully. Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Flow 'volume_create_manager' (e953353f-3057-4d36-967d-c62bd17c0c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc1119d-0f5a-416a-9abc-29545785b93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cc1119d-0f5a-416a-9abc-29545785b93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa73bf9-0969-4381-ae46-93ae94910e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc509812f2f47fc8a8ea8b406aea82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:02Z,use_quota=True,user_id='413e306a4a2f4b73b775577844e2be87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc544378-4915-4ef7-b0ac-5097a1045a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc544378-4915-4ef7-b0ac-5097a1045a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73389418-c2c6-4983-a8b1-8f988bb22046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73389418-c2c6-4983-a8b1-8f988bb22046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa73bf9-0969-4381-ae46-93ae94910e05', 'volume_name': 'volume-9aa73bf9-0969-4381-ae46-93ae94910e05', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e4a609-e60c-4b09-8a49-cfa2450740cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e4a609-e60c-4b09-8a49-cfa2450740cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad04caba-d982-4a3f-844a-abf4c198f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:01 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Volume 9aa73bf9-0969-4381-ae46-93ae94910e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa73bf9-0969-4381-ae46-93ae94910e05', 'volume_size': 1} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa73bf9-0969-4381-ae46-93ae94910e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc509812f2f47fc8a8ea8b406aea82d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:02Z,use_quota=True,user_id='413e306a4a2f4b73b775577844e2be87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Creating volume 9aa73bf9-0969-4381-ae46-93ae94910e05 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:01 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:19:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:01 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 1073741824 Nov 05 22:19:01 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:02 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 1073741824" returned: 0 in 0.598s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:02 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 Nov 05 22:19:02 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:02 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05" returned: 0 in 0.340s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad04caba-d982-4a3f-844a-abf4c198f43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa73bf9-0969-4381-ae46-93ae94910e05', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0c01f9-a3a0-4456-8d85-fe946488b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Volume volume-9aa73bf9-0969-4381-ae46-93ae94910e05 (9aa73bf9-0969-4381-ae46-93ae94910e05): created successfully Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0c01f9-a3a0-4456-8d85-fe946488b652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Flow 'volume_create_manager' (e953353f-3057-4d36-967d-c62bd17c0c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d28b6a2f-c695-42cd-af73-6f49164b1c12 tempest-VolumesListAdminTestJSON-683870431 None] Created volume successfully. Nov 05 22:19:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Acquiring lock "cinder-9aa73bf9-0969-4381-ae46-93ae94910e05-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Lock "cinder-9aa73bf9-0969-4381-ae46-93ae94910e05-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Acquiring lock "cinder-quobyte-9aa73bf9-0969-4381-ae46-93ae94910e05" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Lock "cinder-quobyte-9aa73bf9-0969-4381-ae46-93ae94910e05" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7c288-dea9-4d80-8cde-2791f782fc43]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Flow 'volume_create_manager' (4a039669-b938-4fc2-b741-fec4aee823fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc1f64d-204e-408c-9667-323e5d4a4370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "cinder-2b7386ff-40f6-402c-af41-925d6bd82ac5-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:04 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 Nov 05 22:19:04 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc1f64d-204e-408c-9667-323e5d4a4370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-394320639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3ce072-e25f-494b-8cf2-3322c476d6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f4d41b8194b4d8d701a69c2e1962a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:04Z,use_quota=True,user_id='8faf3e161e5a47cf8880f193f243d0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555d39b-d06b-4379-94b0-d305a9df51ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a555d39b-d06b-4379-94b0-d305a9df51ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9027232-a934-48a6-b4e0-a893d155ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9027232-a934-48a6-b4e0-a893d155ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3ce072-e25f-494b-8cf2-3322c476d6b9', 'volume_name': 'volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc820f4-a8bd-453c-8db6-2d2bdd3349ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc820f4-a8bd-453c-8db6-2d2bdd3349ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a382f7-e003-48d3-803b-720609cb060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:04 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Volume 1f3ce072-e25f-494b-8cf2-3322c476d6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9', 'volume_size': 1} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-394320639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3ce072-e25f-494b-8cf2-3322c476d6b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f4d41b8194b4d8d701a69c2e1962a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:04Z,use_quota=True,user_id='8faf3e161e5a47cf8880f193f243d0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Creating volume 1f3ce072-e25f-494b-8cf2-3322c476d6b9 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:04 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-2b7386ff-40f6-402c-af41-925d6bd82ac5-delete_volume" acquired by "delete_volume" :: waited 0.213s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:04 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 1073741824 Nov 05 22:19:04 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "cinder-quobyte-2b7386ff-40f6-402c-af41-925d6bd82ac5" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-quobyte-2b7386ff-40f6-402c-af41-925d6bd82ac5" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9ad200-2982-4353-b812-6f4069fe3442]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:04 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05" returned: 0 in 0.745s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:04 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05 Nov 05 22:19:04 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:05 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 Nov 05 22:19:05 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:05 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 1073741824" returned: 0 in 0.764s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:05 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 Nov 05 22:19:05 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:05 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9aa73bf9-0969-4381-ae46-93ae94910e05" returned: 0 in 0.611s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Lock "cinder-quobyte-9aa73bf9-0969-4381-ae46-93ae94910e05" released by "delete_volume" :: held 1.489s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:05 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5" returned: 0 in 0.893s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:05 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5 Nov 05 22:19:05 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Created reservations ['58513df1-4208-4a25-bf26-a2302faea9cb', '5ef04e6d-fce5-4ff3-a2dc-865973c5e180', '2dd5f9ce-7b35-4524-8ad6-93a1439bf3d5', 'ee46b805-5a0b-46d5-bfa8-f00ad9692a22'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:05 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9" returned: 0 in 0.501s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a382f7-e003-48d3-803b-720609cb060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc435c7-8f9f-4d62-86d0-912c3d6d4838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Volume volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 (1f3ce072-e25f-494b-8cf2-3322c476d6b9): created successfully Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc435c7-8f9f-4d62-86d0-912c3d6d4838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Flow 'volume_create_manager' (4a039669-b938-4fc2-b741-fec4aee823fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b06ad911-448e-4a5c-9f06-7f8d68ddc434 tempest-ServerActionsTestOtherA-197608559 None] Created volume successfully. Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:06 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:19:06 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:06 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b7386ff-40f6-402c-af41-925d6bd82ac5" returned: 0 in 0.554s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-quobyte-2b7386ff-40f6-402c-af41-925d6bd82ac5" released by "delete_volume" :: held 1.550s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Created reservations ['23bf4302-2ac6-4424-a8c1-778031762005', '4a8cab51-2b60-42ee-8f65-1c92c00970c7', '16cf5184-5c1f-4998-82cb-cd470adb66d2', '846f342b-1dd3-4fdd-81dd-cb9e1af52043'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:06 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.420s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Deleted volume successfully. Nov 05 22:19:06 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:19:06 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1002304e-d76e-41d7-b455-d1c965694b5e tempest-VolumesListAdminTestJSON-683870431 None] Lock "cinder-9aa73bf9-0969-4381-ae46-93ae94910e05-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "cinder-b0d0bd94-8c87-42bd-8402-3468d56daaa6-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-b0d0bd94-8c87-42bd-8402-3468d56daaa6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:06 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.514s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:06 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Deleted volume successfully. Nov 05 22:19:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-782bf264-9084-4ec9-bd8b-3ef8dbbf5fb2 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-2b7386ff-40f6-402c-af41-925d6bd82ac5-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "cinder-quobyte-b0d0bd94-8c87-42bd-8402-3468d56daaa6" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-quobyte-b0d0bd94-8c87-42bd-8402-3468d56daaa6" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:07 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ae311-b19c-430b-8ce9-c7aee369e1fd]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:07 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 Nov 05 22:19:07 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:07 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6" returned: 0 in 0.555s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:07 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6 Nov 05 22:19:07 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:08 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b0d0bd94-8c87-42bd-8402-3468d56daaa6" returned: 0 in 0.350s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-quobyte-b0d0bd94-8c87-42bd-8402-3468d56daaa6" released by "delete_volume" :: held 0.963s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Created reservations ['d3478373-6c80-49f4-bd01-efe42cc29f6d', '02f134fb-191e-43f5-a601-502e39d36983', 'fc529e1b-6bea-4320-a6d5-27c2ab587f21', '4208a9e6-d70f-4c56-93a9-bcbb689635bb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:08 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:19:08 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:08 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Deleted volume successfully. Nov 05 22:19:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bd08fb0f-2752-46ca-a286-c61324c841cb tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-b0d0bd94-8c87-42bd-8402-3468d56daaa6-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "cinder-00df58f1-9596-4b47-9774-a40af5af425e-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-00df58f1-9596-4b47-9774-a40af5af425e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "cinder-quobyte-00df58f1-9596-4b47-9774-a40af5af425e" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-quobyte-00df58f1-9596-4b47-9774-a40af5af425e" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddcd596-8b9c-4cd0-9633-7e0d6f0d6605]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:09 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e Nov 05 22:19:09 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:10 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e" returned: 0 in 0.499s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:10 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e Nov 05 22:19:10 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:10 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-00df58f1-9596-4b47-9774-a40af5af425e" returned: 0 in 0.316s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-quobyte-00df58f1-9596-4b47-9774-a40af5af425e" released by "delete_volume" :: held 0.895s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Created reservations ['0f2e81ec-d1e0-456f-ad14-f44658e5ca45', 'bf593dc0-4e45-4cbc-b2c9-023867b81340', 'e1941b97-3442-4e92-b413-c853b24c1e88', 'cfa37792-8458-4460-b887-dcc03a5639e5'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:10 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:19:10 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:10 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.335s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:10 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Deleted volume successfully. Nov 05 22:19:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b6eb1551-118e-4b0c-9dee-b95b20d0ffc9 tempest-VolumesListAdminTestJSON-1125018088 None] Lock "cinder-00df58f1-9596-4b47-9774-a40af5af425e-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-b4d2e53d-4f14-4971-9bfa-a93976d68876 req-19716d56-ec36-4736-aae7-e98a68e02b57 tempest-AttachVolumeTestJSON-1488034404 None] Terminate volume connection completed successfully. Nov 05 22:19:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b4d2e53d-4f14-4971-9bfa-a93976d68876 req-19716d56-ec36-4736-aae7-e98a68e02b57 tempest-AttachVolumeTestJSON-1488034404 None] Deleting attachment 04f12135-00d6-46cc-932e-4650a0fa964a. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:19:20 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=54,cinder:UPDATE=70,cinder:DELETE=9,cinder:INSERT=15 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:19:30 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=69,cinder:INSERT=17,cinder:SELECT=57,cinder:DELETE=4 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:19:36 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Flow 'volume_create_manager' (a620d5b4-b2ab-4c23-8162-acb471b95b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16514e1-a0ba-44ee-88b2-6451104eb703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16514e1-a0ba-44ee-88b2-6451104eb703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2145427986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1d93f4-818a-42b2-a817-e037ff170e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c728e440fde847ddb82f23c3c71a49a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:37Z,use_quota=True,user_id='d3fb008795ff41b7b955771856a7e70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041338b6-0385-4d73-a62c-284450f41fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041338b6-0385-4d73-a62c-284450f41fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52591b9e-42bd-4050-8b7f-2164da1ea435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52591b9e-42bd-4050-8b7f-2164da1ea435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f1d93f4-818a-42b2-a817-e037ff170e51', 'volume_name': 'volume-9f1d93f4-818a-42b2-a817-e037ff170e51', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed182349-7443-497d-9940-66d3e20eace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed182349-7443-497d-9940-66d3e20eace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba990e2-60e7-4f47-ba82-488fde9dee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Volume 9f1d93f4-818a-42b2-a817-e037ff170e51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f1d93f4-818a-42b2-a817-e037ff170e51', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:19:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Trying to clone 9f1d93f4-818a-42b2-a817-e037ff170e51 from image 7f51a389-75a1-4170-8607-9bba700950bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:19:38 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:19:38 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:19:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e9d52-084e-450a-834f-04641b92417b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:38 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD Nov 05 22:19:38 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:38 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:38 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc is fetched for user d3fb008795ff41b7b955771856a7e70a. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:19:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6b05c1-2f4e-44be-be20-addafb02a7ef]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:38 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD Nov 05 22:19:38 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:39 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD" returned: 0 in 0.638s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2145427986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1d93f4-818a-42b2-a817-e037ff170e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c728e440fde847ddb82f23c3c71a49a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:37Z,use_quota=True,user_id='d3fb008795ff41b7b955771856a7e70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Creating volume 9f1d93f4-818a-42b2-a817-e037ff170e51 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:39 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:19:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:39 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 1073741824 Nov 05 22:19:39 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:40 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 1073741824" returned: 0 in 0.784s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:40 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:19:40 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:40 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 Nov 05 22:19:40 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:40 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.473s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:19:40 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51" returned: 0 in 0.496s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Attempting download of 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume 9f1d93f4-818a-42b2-a817-e037ff170e51. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27a440-42a1-4897-979a-6ca4b58f684a]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc__hwvsg6k {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:40 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc__hwvsg6k Nov 05 22:19:40 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:41 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc__hwvsg6k" returned: 0 in 0.493s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc__hwvsg6k {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:41 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc__hwvsg6k Nov 05 22:19:41 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:41 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc__hwvsg6k" returned: 1 in 0.588s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc__hwvsg6k' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:19:41 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbbdba4-f133-4aea-8170-0f771cd20741]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:42 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD Nov 05 22:19:42 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:42 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD" returned: 0 in 0.860s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:42 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] 7f51a389-75a1-4170-8607-9bba700950bc was qcow2, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:19:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:42 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 Nov 05 22:19:42 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:46 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51" returned: 0 in 3.637s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_empvpdf8devstack@QuobyteHD, size 112.00 MB, duration 3.64 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:19:46 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Converted 112.00 MB image at 30.79 MB/s Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-83b0081e-6238-4040-99b1-c2eeebb79e65 req-7674ddd4-046f-4b8e-b417-60c6e29b2e13 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-83b0081e-6238-4040-99b1-c2eeebb79e65 req-7674ddd4-046f-4b8e-b417-60c6e29b2e13 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:46 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 1G Nov 05 22:19:46 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-83b0081e-6238-4040-99b1-c2eeebb79e65 req-7674ddd4-046f-4b8e-b417-60c6e29b2e13 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-83b0081e-6238-4040-99b1-c2eeebb79e65 req-7674ddd4-046f-4b8e-b417-60c6e29b2e13 tempest-ServerActionsTestOtherA-197608559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a912160a-c9c4-451a-adb6-c4ca705a1be6', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:19:46 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-83b0081e-6238-4040-99b1-c2eeebb79e65 req-7674ddd4-046f-4b8e-b417-60c6e29b2e13 tempest-ServerActionsTestOtherA-197608559 None] attachment_update completed successfully. Nov 05 22:19:46 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 1G" returned: 0 in 0.493s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Downloaded image 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume 9f1d93f4-818a-42b2-a817-e037ff170e51 successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc for user d3fb008795ff41b7b955771856a7e70a is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:19:46 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Marking volume 9f1d93f4-818a-42b2-a817-e037ff170e51 as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Copying metadata from image 7f51a389-75a1-4170-8607-9bba700950bc to 9f1d93f4-818a-42b2-a817-e037ff170e51. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Creating volume glance metadata for volume 9f1d93f4-818a-42b2-a817-e037ff170e51 backed by image 7f51a389-75a1-4170-8607-9bba700950bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba990e2-60e7-4f47-ba82-488fde9dee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1d93f4-818a-42b2-a817-e037ff170e51', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ab0ed7-da7a-4925-9177-def8c38c2574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:47 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Volume volume-9f1d93f4-818a-42b2-a817-e037ff170e51 (9f1d93f4-818a-42b2-a817-e037ff170e51): created successfully Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ab0ed7-da7a-4925-9177-def8c38c2574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Flow 'volume_create_manager' (a620d5b4-b2ab-4c23-8162-acb471b95b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-afeb4045-32e4-4c34-bd7b-18284f28006f tempest-VolumesImageMetadata-779508065 None] Created volume successfully. Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (45ce7af6-dd9b-497d-b2ad-db85e3241e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae77fb4-0b03-4106-b0d0-6f5dad3c7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae77fb4-0b03-4106-b0d0-6f5dad3c7db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-958511513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3928e1-e89b-4416-879d-d9fe9fd5cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:48Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440cfb04-625d-464a-a245-aaeea6a57a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440cfb04-625d-464a-a245-aaeea6a57a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d548c76a-0ca1-41dd-8ff7-c0f1b41bc658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d548c76a-0ca1-41dd-8ff7-c0f1b41bc658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3928e1-e89b-4416-879d-d9fe9fd5cdcf', 'volume_name': 'volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1993f13-9df5-49a7-9f39-7351119b24b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1993f13-9df5-49a7-9f39-7351119b24b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179de3aa-fe45-4a70-8c1d-784f046c53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:47 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Volume 6f3928e1-e89b-4416-879d-d9fe9fd5cdcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf', 'volume_size': 1} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-958511513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3928e1-e89b-4416-879d-d9fe9fd5cdcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:48Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Creating volume 6f3928e1-e89b-4416-879d-d9fe9fd5cdcf {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:47 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:19:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:47 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf 1073741824 Nov 05 22:19:47 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:48 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf 1073741824" returned: 0 in 0.471s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:48 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf Nov 05 22:19:48 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:48 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" returned: 0 in 0.370s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179de3aa-fe45-4a70-8c1d-784f046c53d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd08f9d8-13c9-4897-a6cd-9fa39087437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:48 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Volume volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf (6f3928e1-e89b-4416-879d-d9fe9fd5cdcf): created successfully Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd08f9d8-13c9-4897-a6cd-9fa39087437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (45ce7af6-dd9b-497d-b2ad-db85e3241e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:48 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6f8bf905-32a6-4210-9a19-67efd01d7000 tempest-VolumesActionsTest-242220448 None] Created volume successfully. Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Acquiring lock "cinder-9f1d93f4-818a-42b2-a817-e037ff170e51-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Lock "cinder-9f1d93f4-818a-42b2-a817-e037ff170e51-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Acquiring lock "cinder-quobyte-9f1d93f4-818a-42b2-a817-e037ff170e51" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Lock "cinder-quobyte-9f1d93f4-818a-42b2-a817-e037ff170e51" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[319e5c97-fdd4-42a0-b138-85d178a30179]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:49 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 Nov 05 22:19:49 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:49 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:49 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51 Nov 05 22:19:49 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-929289a5-71d4-4210-8a0e-b127054d6e30 tempest-VolumesActionsTest-242220448 None] Acquiring lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" by "attach_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-929289a5-71d4-4210-8a0e-b127054d6e30 tempest-VolumesActionsTest-242220448 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" acquired by "attach_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:49 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9f1d93f4-818a-42b2-a817-e037ff170e51" returned: 0 in 0.383s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Lock "cinder-quobyte-9f1d93f4-818a-42b2-a817-e037ff170e51" released by "delete_volume" :: held 0.903s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-929289a5-71d4-4210-8a0e-b127054d6e30 tempest-VolumesActionsTest-242220448 None] Attaching volume 6f3928e1-e89b-4416-879d-d9fe9fd5cdcf to instance 433d8250-5d0e-4053-b9ac-9f66e085e3b0 at mountpoint /dev/vdb on host None. Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Created reservations ['318d1860-1cb7-4b3c-9f54-fef0dbf258a1', 'da00068c-0899-4517-9968-96fbbb466290', '5e56e104-c81b-478f-9861-83aacae9d3c4', 'b2a5170a-5467-4b4d-9263-b2e9edd91572'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-929289a5-71d4-4210-8a0e-b127054d6e30 tempest-VolumesActionsTest-242220448 None] Attach volume completed successfully. Nov 05 22:19:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-929289a5-71d4-4210-8a0e-b127054d6e30 tempest-VolumesActionsTest-242220448 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" released by "attach_volume" :: held 0.145s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:50 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:19:50 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:50 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.378s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Deleted volume successfully. Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0c470145-84f7-4077-8177-26fe15eb2702 tempest-VolumesImageMetadata-779508065 None] Lock "cinder-9f1d93f4-818a-42b2-a817-e037ff170e51-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-bf2e2666-9f5f-4606-8707-d76f9c6f6c58 req-d313e86e-0a0d-4a9d-bd73-46984fcb9c90 tempest-ServerActionsTestOtherA-197608559 None] Terminate volume connection completed successfully. Nov 05 22:19:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-bf2e2666-9f5f-4606-8707-d76f9c6f6c58 req-d313e86e-0a0d-4a9d-bd73-46984fcb9c90 tempest-ServerActionsTestOtherA-197608559 None] Deleting attachment a912160a-c9c4-451a-adb6-c4ca705a1be6. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:19:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-10ca6121-2ff0-4231-bb0c-88b31c9fb708 tempest-VolumesActionsTest-553179858 None] Terminate volume connection completed successfully. Nov 05 22:19:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10ca6121-2ff0-4231-bb0c-88b31c9fb708 tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-detach_volume" by "detach_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10ca6121-2ff0-4231-bb0c-88b31c9fb708 tempest-VolumesActionsTest-553179858 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-10ca6121-2ff0-4231-bb0c-88b31c9fb708 tempest-VolumesActionsTest-553179858 None] Detaching volume 6f3928e1-e89b-4416-879d-d9fe9fd5cdcf from instance 433d8250-5d0e-4053-b9ac-9f66e085e3b0. Nov 05 22:19:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-10ca6121-2ff0-4231-bb0c-88b31c9fb708 tempest-VolumesActionsTest-553179858 None] Detach volume completed successfully. Nov 05 22:19:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10ca6121-2ff0-4231-bb0c-88b31c9fb708 tempest-VolumesActionsTest-553179858 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-bf2e2666-9f5f-4606-8707-d76f9c6f6c58 req-1419f96d-57c6-4ce9-a00b-f7e83bc44e2e tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-bf2e2666-9f5f-4606-8707-d76f9c6f6c58 req-1419f96d-57c6-4ce9-a00b-f7e83bc44e2e tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-bf2e2666-9f5f-4606-8707-d76f9c6f6c58 req-1419f96d-57c6-4ce9-a00b-f7e83bc44e2e tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-bf2e2666-9f5f-4606-8707-d76f9c6f6c58 req-1419f96d-57c6-4ce9-a00b-f7e83bc44e2e tempest-ServerActionsTestOtherA-197608559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2df7dd6-5ab8-43da-ac11-45b7a203450b', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-32eb619c-d1ff-4f76-99d1-13d2c0acc988 tempest-VolumesActionsTest-242220448 None] Acquiring lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-detach_volume" by "detach_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-32eb619c-d1ff-4f76-99d1-13d2c0acc988 tempest-VolumesActionsTest-242220448 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-32eb619c-d1ff-4f76-99d1-13d2c0acc988 tempest-VolumesActionsTest-242220448 None] Volume detach called, but volume not attached. Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-32eb619c-d1ff-4f76-99d1-13d2c0acc988 tempest-VolumesActionsTest-242220448 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-bf2e2666-9f5f-4606-8707-d76f9c6f6c58 req-1419f96d-57c6-4ce9-a00b-f7e83bc44e2e tempest-ServerActionsTestOtherA-197608559 None] attachment_update completed successfully. Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Acquiring lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Acquiring lock "cinder-quobyte-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Lock "cinder-quobyte-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ec30e9-22e4-4493-bec5-d6fc338e57f1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:19:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:53 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf Nov 05 22:19:53 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:53 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" returned: 0 in 0.578s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:53 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf Nov 05 22:19:53 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:53 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" returned: 0 in 0.433s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Lock "cinder-quobyte-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf" released by "delete_volume" :: held 1.114s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Created reservations ['d99652e2-c761-4544-8757-b86e99896c39', '7ff592b4-bbb1-4e19-8a42-ad7f20d1e9d0', '06cab06d-aed6-4eb3-8a31-17a80faa2d05', 'a1f2498b-facd-477a-b714-719db87c7157'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:54 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:19:54 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:54 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.683s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:19:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Deleted volume successfully. Nov 05 22:19:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ed859c9e-6b74-4c38-ba73-a6d049e1abd6 tempest-VolumesActionsTest-242220448 None] Lock "cinder-6f3928e1-e89b-4416-879d-d9fe9fd5cdcf-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Flow 'volume_create_manager' (0c51d168-cf41-4333-a789-e1b86f756d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9fc44c-7a81-45c6-86d3-6b2b6ac0c236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9fc44c-7a81-45c6-86d3-6b2b6ac0c236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1794304223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08d6a43-7927-44dc-bc1e-b19cc7e788ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e48ecb96d84cbb8f8179ceb939d638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:58Z,use_quota=True,user_id='da5046a3c51e493bbf54458d2f321e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d021bc-6c17-4d36-95c9-a1c4937a94b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d021bc-6c17-4d36-95c9-a1c4937a94b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511f9a8b-c1b6-40b9-8fc1-15b7e5532081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511f9a8b-c1b6-40b9-8fc1-15b7e5532081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08d6a43-7927-44dc-bc1e-b19cc7e788ca', 'volume_name': 'volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16035333-4a4b-49a1-a0ec-6e7c86b57f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16035333-4a4b-49a1-a0ec-6e7c86b57f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c55170-bbd7-4d26-894f-0073c531b316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:19:58 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Volume d08d6a43-7927-44dc-bc1e-b19cc7e788ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca', 'volume_size': 1} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1794304223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08d6a43-7927-44dc-bc1e-b19cc7e788ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e48ecb96d84cbb8f8179ceb939d638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:19:58Z,use_quota=True,user_id='da5046a3c51e493bbf54458d2f321e83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Creating volume d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:19:58 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:19:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:58 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca 1073741824 Nov 05 22:19:58 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:19:59 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Nov 05 22:19:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca 1073741824" returned: 0 in 1.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:19:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:19:59 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca Nov 05 22:19:59 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (46675459-875a-46e5-863c-acd4445204f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb3f72f-edca-4c05-b272-c461a883eaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb3f72f-edca-4c05-b272-c461a883eaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1525267377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0a6e8c-c217-45bd-8f63-13cd0f23ca95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:00Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a65456-c9a9-40b5-be37-19793619fa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a65456-c9a9-40b5-be37-19793619fa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c03ec9b-3cf2-4284-bc8f-63787868f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c03ec9b-3cf2-4284-bc8f-63787868f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0a6e8c-c217-45bd-8f63-13cd0f23ca95', 'volume_name': 'volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca94f2f-821c-427b-80c9-5b47d02aeabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca94f2f-821c-427b-80c9-5b47d02aeabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fdd4a2-6fb8-47aa-bc3f-1175ff656f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:00 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Volume ea0a6e8c-c217-45bd-8f63-13cd0f23ca95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95', 'volume_size': 1} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:00 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" returned: 0 in 0.586s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1525267377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0a6e8c-c217-45bd-8f63-13cd0f23ca95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:00Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Creating volume ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:00 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c55170-bbd7-4d26-894f-0073c531b316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:00 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 1073741824 Nov 05 22:20:00 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a63c20-2c3c-406a-82f7-7f50e9897faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:00 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Volume volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca (d08d6a43-7927-44dc-bc1e-b19cc7e788ca): created successfully Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87a63c20-2c3c-406a-82f7-7f50e9897faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Flow 'volume_create_manager' (0c51d168-cf41-4333-a789-e1b86f756d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-29981094-6432-4337-9d0c-47dc5b706071 tempest-SnapshotMetadataTestJSON-1277211329 None] Created volume successfully. Nov 05 22:20:00 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 1073741824" returned: 0 in 0.542s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:01 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 Nov 05 22:20:01 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:01 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95" returned: 0 in 0.294s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9fdd4a2-6fb8-47aa-bc3f-1175ff656f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d61266c-4343-4918-8d85-a9e86187306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:01 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Volume volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 (ea0a6e8c-c217-45bd-8f63-13cd0f23ca95): created successfully Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d61266c-4343-4918-8d85-a9e86187306e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (46675459-875a-46e5-863c-acd4445204f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4e94c6b0-88dc-48bf-9c64-5f476ce2cc00 tempest-VolumesActionsTest-242220448 None] Created volume successfully. Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Creating offline snapshot 5b683d5b-26ea-4f35-9fb9-7c92d380bdbb of volume d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[55592bcf-d0ed-449f-b736-1086eca5e702]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:01 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca Nov 05 22:20:01 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:02 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" returned: 0 in 0.395s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:02 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb 1G Nov 05 22:20:02 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Lock "cinder-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-quobyte-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba700a-4c3f-4f67-bb17-b6e2dcfeb9c7]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:02 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 Nov 05 22:20:02 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:02 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb 1G" returned: 0 in 0.476s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:02 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb Nov 05 22:20:02 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:02 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95" returned: 0 in 0.452s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:02 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95 Nov 05 22:20:02 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:03 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" returned: 0 in 0.363s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:03 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb is being set with open permissions: ugo+rw Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:03 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb Nov 05 22:20:03 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:03 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95" returned: 0 in 0.370s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95" released by "delete_volume" :: held 0.873s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Created reservations ['6170eccc-4995-49ca-821a-15ed2a260cbc', '1431ea2a-08cb-4a2f-8418-93623be86eee', '959e2f15-b9f6-41df-8cbe-9cff37b4eff9', '506a7627-1e19-46ed-b3f7-5bb19f1ae1c4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:03 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" returned: 0 in 0.424s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:03 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:03 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:03 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.info Nov 05 22:20:03 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:03 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.info" returned: 0 in 0.301s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:03 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.info is being set with open permissions: ugo+rw Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:03 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.info Nov 05 22:20:03 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:03 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.447s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:03 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Deleted volume successfully. Nov 05 22:20:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a2438529-30e0-4114-9a4e-300ea845a80d tempest-VolumesActionsTest-553179858 None] Lock "cinder-ea0a6e8c-c217-45bd-8f63-13cd0f23ca95-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:04 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.info" returned: 0 in 0.329s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-991d3030-cfd1-4d40-83ef-fe58808b66a4 tempest-SnapshotMetadataTestJSON-1277211329 None] Create snapshot completed successfully Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (13356abf-543d-4943-878b-7a2ced6b4302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb59e5cc-5cdd-4e3b-973f-d2f3c47b1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb59e5cc-5cdd-4e3b-973f-d2f3c47b1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877705309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f655327-04b6-4929-93c5-19e4789ac210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:05Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86706cc4-8480-4a1e-8371-7ee35f1fe6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86706cc4-8480-4a1e-8371-7ee35f1fe6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f9a6d2-6d9c-4a8a-b587-345ec9190c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f9a6d2-6d9c-4a8a-b587-345ec9190c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f655327-04b6-4929-93c5-19e4789ac210', 'volume_name': 'volume-8f655327-04b6-4929-93c5-19e4789ac210', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f53ddd-06e7-4bf2-9501-22500579022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f53ddd-06e7-4bf2-9501-22500579022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d04c85-4796-43f2-843b-5303bc59dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Volume 8f655327-04b6-4929-93c5-19e4789ac210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f655327-04b6-4929-93c5-19e4789ac210', 'volume_size': 1} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877705309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f655327-04b6-4929-93c5-19e4789ac210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:05Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Creating volume 8f655327-04b6-4929-93c5-19e4789ac210 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:05 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:05 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 1073741824 Nov 05 22:20:05 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:06 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "cinder-5b683d5b-26ea-4f35-9fb9-7c92d380bdbb-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 1073741824" returned: 0 in 0.659s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-5b683d5b-26ea-4f35-9fb9-7c92d380bdbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "cinder-quobyte-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-quobyte-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "cinder-quobyte-5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-quobyte-5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Deleting offline snapshot 5b683d5b-26ea-4f35-9fb9-7c92d380bdbb of volume d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:20:06 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 Nov 05 22:20:06 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] snapshot_file for this snap is: volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98d7ec0-a0c2-4bb3-9f63-e98f27bee9a1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:06 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb Nov 05 22:20:06 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:06 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210" returned: 0 in 0.385s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d04c85-4796-43f2-843b-5303bc59dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f655327-04b6-4929-93c5-19e4789ac210', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31fd7ec-7e66-49bf-9e09-f19d6c7faa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:06 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Volume volume-8f655327-04b6-4929-93c5-19e4789ac210 (8f655327-04b6-4929-93c5-19e4789ac210): created successfully Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31fd7ec-7e66-49bf-9e09-f19d6c7faa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (13356abf-543d-4943-878b-7a2ced6b4302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1e3cae62-22a6-4a72-9c2d-10801555b737 tempest-VolumesActionsTest-242220448 None] Created volume successfully. Nov 05 22:20:06 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c4efb-9967-4095-9321-5339fbd507f1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:06 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca Nov 05 22:20:06 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:07 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" returned: 0 in 0.419s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:07 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb Nov 05 22:20:07 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-8f655327-04b6-4929-93c5-19e4789ac210-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Lock "cinder-8f655327-04b6-4929-93c5-19e4789ac210-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:07 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" returned: 0 in 0.593s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-quobyte-8f655327-04b6-4929-93c5-19e4789ac210" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-8f655327-04b6-4929-93c5-19e4789ac210" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:07 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb Nov 05 22:20:07 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc495e4c-e27f-459c-b9a7-1e971ea6f4cd]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:08 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 Nov 05 22:20:08 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:08 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca.5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" returned: 0 in 0.340s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-quobyte-5b683d5b-26ea-4f35-9fb9-7c92d380bdbb" released by "_delete_snapshot" :: held 2.005s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-quobyte-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" released by "delete_snapshot" :: held 2.065s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Created reservations ['26e95f03-52ab-4cba-81bb-917ea0c8d3a7', 'd452ed79-49ed-4977-8a15-73c8041801db', '151ebdc3-af8e-4f8d-9c71-4a24d64ee591', '9d63f790-2357-4019-9989-76cfd0de8bd3'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:08 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210" returned: 0 in 0.475s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:08 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210 Nov 05 22:20:08 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Delete snapshot completed successfully. Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-00013d04-f0bf-4128-8fd8-b96414d994fd tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-5b683d5b-26ea-4f35-9fb9-7c92d380bdbb-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:08 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8f655327-04b6-4929-93c5-19e4789ac210" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-8f655327-04b6-4929-93c5-19e4789ac210" released by "delete_volume" :: held 0.834s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Created reservations ['e9464b8e-1551-48f6-b0a8-7bafe23bc8ad', '97c9db92-f7cb-4576-a4b7-609aac76304a', '277b13b0-76e4-4cb0-98ec-244dc4fcb0c4', '0a9270c2-34d3-417e-97fb-876c2c7ff49a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:08 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:08 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:09 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.297s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Deleted volume successfully. Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d87b4fd-022b-4c25-aebb-0855968849df tempest-VolumesActionsTest-553179858 None] Lock "cinder-8f655327-04b6-4929-93c5-19e4789ac210-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "cinder-d08d6a43-7927-44dc-bc1e-b19cc7e788ca-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-d08d6a43-7927-44dc-bc1e-b19cc7e788ca-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "cinder-quobyte-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-quobyte-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" acquired by "delete_volume" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc08b1-576b-4b54-9b29-10f74fbb0512]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (47cc216b-5347-46ee-80bf-6f1062ec8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5315c550-e3b0-48e1-a1b4-a9b2b22fea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5315c550-e3b0-48e1-a1b4-a9b2b22fea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1338654967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e361cf-2caf-4fe8-abe9-533283897c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:10Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef48ad4-eed9-423f-8430-42559341a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef48ad4-eed9-423f-8430-42559341a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6da66a5-28a3-4f9a-ba6e-c972b3cee8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6da66a5-28a3-4f9a-ba6e-c972b3cee8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e361cf-2caf-4fe8-abe9-533283897c86', 'volume_name': 'volume-80e361cf-2caf-4fe8-abe9-533283897c86', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c1bd26-ec69-410b-b939-22d670372cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c1bd26-ec69-410b-b939-22d670372cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880b8d57-85f6-4a5b-a840-cb4f9a33cf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Volume 80e361cf-2caf-4fe8-abe9-533283897c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e361cf-2caf-4fe8-abe9-533283897c86', 'volume_size': 1} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1338654967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e361cf-2caf-4fe8-abe9-533283897c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:10Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Creating volume 80e361cf-2caf-4fe8-abe9-533283897c86 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:10 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:10 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca Nov 05 22:20:10 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:10 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 1073741824 Nov 05 22:20:10 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:10 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" returned: 0 in 0.653s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:10 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca Nov 05 22:20:10 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:10 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 1073741824" returned: 0 in 0.776s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:10 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 Nov 05 22:20:10 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:10 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" returned: 0 in 0.438s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-quobyte-d08d6a43-7927-44dc-bc1e-b19cc7e788ca" released by "delete_volume" :: held 1.257s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Created reservations ['ba7f6e8c-c56d-4ae7-ab1b-d102a455b6ec', '3687ed32-e0c3-4d32-b801-f4811cef39b6', 'bf32411b-ac1e-4969-86b2-406fed656eb6', '985c6af9-79a6-4b9e-b0ab-5a7879c8321a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:11 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:11 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:11 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86" returned: 0 in 0.441s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880b8d57-85f6-4a5b-a840-cb4f9a33cf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e361cf-2caf-4fe8-abe9-533283897c86', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a068725-f72d-4faa-a76b-4bd7e130cecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Volume volume-80e361cf-2caf-4fe8-abe9-533283897c86 (80e361cf-2caf-4fe8-abe9-533283897c86): created successfully Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a068725-f72d-4faa-a76b-4bd7e130cecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (47cc216b-5347-46ee-80bf-6f1062ec8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-52175a5b-9632-430b-b563-4e624b29bf0d tempest-VolumesActionsTest-242220448 None] Created volume successfully. Nov 05 22:20:11 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.298s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Deleted volume successfully. Nov 05 22:20:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5decbd05-6bb8-4ef2-97b3-4c428e905ad7 tempest-SnapshotMetadataTestJSON-1277211329 None] Lock "cinder-d08d6a43-7927-44dc-bc1e-b19cc7e788ca-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-80e361cf-2caf-4fe8-abe9-533283897c86-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Lock "cinder-80e361cf-2caf-4fe8-abe9-533283897c86-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-quobyte-80e361cf-2caf-4fe8-abe9-533283897c86" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-80e361cf-2caf-4fe8-abe9-533283897c86" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9bbc7e-c7a3-455d-a25c-ebcfa52a768f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:12 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 Nov 05 22:20:12 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:12 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86" returned: 0 in 0.437s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:12 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86 Nov 05 22:20:12 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:12 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80e361cf-2caf-4fe8-abe9-533283897c86" returned: 0 in 0.281s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-80e361cf-2caf-4fe8-abe9-533283897c86" released by "delete_volume" :: held 0.775s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Created reservations ['68a74dae-9e4b-4563-a6b0-69ecc2db0748', 'c0f87f42-795e-460b-b1e5-1a59e1129e1a', '05d7ec90-9352-41e0-adb9-73c3ab1b8925', '6b2cb105-507f-4cb0-b7d4-73c82762036d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:13 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:13 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:13 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.447s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Deleted volume successfully. Nov 05 22:20:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb6fa9b3-ba81-4ec3-90ae-dc1e4a752543 tempest-VolumesActionsTest-553179858 None] Lock "cinder-80e361cf-2caf-4fe8-abe9-533283897c86-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (d9e2fd3f-cb5e-4230-91dd-895d931d65f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e8e958-7951-4bbe-8cf1-c632711028c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e8e958-7951-4bbe-8cf1-c632711028c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1922147074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58a1ccb-5620-4510-a293-22df3a98adb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:15Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae41196-f1ee-4d4a-bfd9-41c7dc5ca9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae41196-f1ee-4d4a-bfd9-41c7dc5ca9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20755d8e-cf5d-4ba3-8465-2add6ee4be07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20755d8e-cf5d-4ba3-8465-2add6ee4be07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58a1ccb-5620-4510-a293-22df3a98adb4', 'volume_name': 'volume-d58a1ccb-5620-4510-a293-22df3a98adb4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33521f09-613e-4508-9993-2dd0d6a893ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33521f09-613e-4508-9993-2dd0d6a893ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d828e36d-4a1a-4676-8a8e-b592711d2e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:14 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Volume d58a1ccb-5620-4510-a293-22df3a98adb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58a1ccb-5620-4510-a293-22df3a98adb4', 'volume_size': 1} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1922147074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58a1ccb-5620-4510-a293-22df3a98adb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:15Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Creating volume d58a1ccb-5620-4510-a293-22df3a98adb4 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:14 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:14 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 1073741824 Nov 05 22:20:14 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:15 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 1073741824" returned: 0 in 0.723s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:15 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 Nov 05 22:20:15 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:15 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4" returned: 0 in 0.319s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d828e36d-4a1a-4676-8a8e-b592711d2e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58a1ccb-5620-4510-a293-22df3a98adb4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436b9e08-5296-4f52-84b2-8d8e18a4035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:16 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Volume volume-d58a1ccb-5620-4510-a293-22df3a98adb4 (d58a1ccb-5620-4510-a293-22df3a98adb4): created successfully Nov 05 22:20:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436b9e08-5296-4f52-84b2-8d8e18a4035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (d9e2fd3f-cb5e-4230-91dd-895d931d65f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-eddb9915-a128-4ce0-89a4-73ff440158e9 tempest-VolumesActionsTest-242220448 None] Created volume successfully. Nov 05 22:20:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-d58a1ccb-5620-4510-a293-22df3a98adb4-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Lock "cinder-d58a1ccb-5620-4510-a293-22df3a98adb4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Acquiring lock "cinder-quobyte-d58a1ccb-5620-4510-a293-22df3a98adb4" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-d58a1ccb-5620-4510-a293-22df3a98adb4" acquired by "delete_volume" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[97844578-b206-4054-8fbd-a1a09497aced]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:17 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 Nov 05 22:20:17 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:18 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4" returned: 0 in 0.630s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:18 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4 Nov 05 22:20:18 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:18 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d58a1ccb-5620-4510-a293-22df3a98adb4" returned: 0 in 0.662s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Lock "cinder-quobyte-d58a1ccb-5620-4510-a293-22df3a98adb4" released by "delete_volume" :: held 1.390s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Created reservations ['91661a44-137d-4c4e-96fe-f1471650b145', '418c4364-24b7-4206-bc9b-ae6fa54a91c2', '09d9ee44-f78a-4589-bc59-d97b34a20091', '7ae2ef5b-82f9-4bcd-89d3-2c30417043dd'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:19 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:19 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:19 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.527s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:19 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Deleted volume successfully. Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d172d5e5-772e-44f0-b78e-1c1352458e96 tempest-VolumesActionsTest-553179858 None] Lock "cinder-d58a1ccb-5620-4510-a293-22df3a98adb4-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:19 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Flow 'volume_create_manager' (875b6094-ca14-4ada-b710-1e9ca06fcd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3dfbf4-ba64-4a4f-9d69-4d707079865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3dfbf4-ba64-4a4f-9d69-4d707079865d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1258309145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d018fe-9412-4bc7-bcd5-adc95dc865d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50bddf638d294b0785ef95474066e925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:20Z,use_quota=True,user_id='03145b3cd6f54ec8ab78692b7f874a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d01cc7-e1fc-469b-af8e-1b77b9d7e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d01cc7-e1fc-469b-af8e-1b77b9d7e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2845d1a-1026-4a8d-b401-0cbbdd8b1265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2845d1a-1026-4a8d-b401-0cbbdd8b1265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d018fe-9412-4bc7-bcd5-adc95dc865d5', 'volume_name': 'volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3324fce0-9eed-48c0-a2ed-4c8f619d9902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3324fce0-9eed-48c0-a2ed-4c8f619d9902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783805f5-5497-422a-862a-f4f7ec24b6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:20 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Volume 52d018fe-9412-4bc7-bcd5-adc95dc865d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5', 'volume_size': 1} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1258309145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d018fe-9412-4bc7-bcd5-adc95dc865d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50bddf638d294b0785ef95474066e925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:20Z,use_quota=True,user_id='03145b3cd6f54ec8ab78692b7f874a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Creating volume 52d018fe-9412-4bc7-bcd5-adc95dc865d5 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:20 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:20 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 1073741824 Nov 05 22:20:20 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:20 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:20 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (65c3af94-c5cd-4305-b0df-142098384ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2167a40a-c8a7-4bd9-a444-4d9d886a6541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 1073741824" returned: 0 in 0.785s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2167a40a-c8a7-4bd9-a444-4d9d886a6541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972177062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae002fe2-5646-463b-880e-7ff92e02080b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:21Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61ac32a-a0ce-433f-876e-240cfbf266c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61ac32a-a0ce-433f-876e-240cfbf266c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a5d47b-6b5c-4626-855c-d7c577b7a37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a5d47b-6b5c-4626-855c-d7c577b7a37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae002fe2-5646-463b-880e-7ff92e02080b', 'volume_name': 'volume-ae002fe2-5646-463b-880e-7ff92e02080b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972d290c-21b6-416f-89cf-c62374e481a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972d290c-21b6-416f-89cf-c62374e481a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a8e4c3-cb37-4d77-8be7-74fe1f025bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:21 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Volume ae002fe2-5646-463b-880e-7ff92e02080b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae002fe2-5646-463b-880e-7ff92e02080b', 'volume_size': 1} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:21 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 Nov 05 22:20:21 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:21 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5" returned: 0 in 0.280s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-972177062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae002fe2-5646-463b-880e-7ff92e02080b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9f44a3dd89e4859bb3337edd4e2c803',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:21Z,use_quota=True,user_id='c635eedeba2d4e8caadbd66a97873c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Creating volume ae002fe2-5646-463b-880e-7ff92e02080b {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:21 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783805f5-5497-422a-862a-f4f7ec24b6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a80f85-584c-4ad6-a130-8be00e725aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:21 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b 1073741824 Nov 05 22:20:21 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:21 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Volume volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 (52d018fe-9412-4bc7-bcd5-adc95dc865d5): created successfully Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a80f85-584c-4ad6-a130-8be00e725aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Flow 'volume_create_manager' (875b6094-ca14-4ada-b710-1e9ca06fcd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-e89bf093-19ce-45ff-8c29-143f389937ef req-62c0e480-b6d5-41da-a10a-c328e03121a0 tempest-ServerActionsTestOtherA-197608559 None] Terminate volume connection completed successfully. Nov 05 22:20:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-e89bf093-19ce-45ff-8c29-143f389937ef req-62c0e480-b6d5-41da-a10a-c328e03121a0 tempest-ServerActionsTestOtherA-197608559 None] Deleting attachment c2df7dd6-5ab8-43da-ac11-45b7a203450b. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:20:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e1ab7686-7466-4c26-b8c6-a67b6dc89a26 tempest-AbsoluteLimitsTests-959885711 None] Created volume successfully. Nov 05 22:20:22 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b 1073741824" returned: 0 in 0.587s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:22 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b Nov 05 22:20:22 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Acquiring lock "cinder-52d018fe-9412-4bc7-bcd5-adc95dc865d5-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Lock "cinder-52d018fe-9412-4bc7-bcd5-adc95dc865d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Acquiring lock "cinder-quobyte-52d018fe-9412-4bc7-bcd5-adc95dc865d5" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Lock "cinder-quobyte-52d018fe-9412-4bc7-bcd5-adc95dc865d5" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b69866-3818-467b-a22c-a2f58c860a53]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:22 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b" returned: 0 in 0.298s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a8e4c3-cb37-4d77-8be7-74fe1f025bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae002fe2-5646-463b-880e-7ff92e02080b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c224e0-e308-4da1-9186-57c3ee3f66c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:22 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Volume volume-ae002fe2-5646-463b-880e-7ff92e02080b (ae002fe2-5646-463b-880e-7ff92e02080b): created successfully Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c224e0-e308-4da1-9186-57c3ee3f66c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Flow 'volume_create_manager' (65c3af94-c5cd-4305-b0df-142098384ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:22 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1abec0b1-0d55-400d-83a9-ef4b4054a8f2 tempest-VolumesActionsTest-242220448 None] Created volume successfully. Nov 05 22:20:22 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 Nov 05 22:20:22 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:22 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:22 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5 Nov 05 22:20:22 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:23 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-52d018fe-9412-4bc7-bcd5-adc95dc865d5" returned: 0 in 0.540s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Lock "cinder-quobyte-52d018fe-9412-4bc7-bcd5-adc95dc865d5" released by "delete_volume" :: held 1.089s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Created reservations ['67f581a9-f637-458a-8cfc-3466e964085b', '49377c6f-542a-4e8f-b7ff-0286e3c9fcfe', '5ce5e6fa-901b-4d0f-bf65-9555b156d9e0', '22a46e35-9bb1-4cf1-ba13-a38235bcb447'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:23 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:23 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:24 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.684s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:24 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Deleted volume successfully. Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3ea5c60b-d9b1-4b3a-ae88-9046e10f3b4f tempest-AbsoluteLimitsTests-959885711 None] Lock "cinder-52d018fe-9412-4bc7-bcd5-adc95dc865d5-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Acquiring lock "cinder-ae002fe2-5646-463b-880e-7ff92e02080b-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Lock "cinder-ae002fe2-5646-463b-880e-7ff92e02080b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Acquiring lock "cinder-quobyte-ae002fe2-5646-463b-880e-7ff92e02080b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Lock "cinder-quobyte-ae002fe2-5646-463b-880e-7ff92e02080b" acquired by "delete_volume" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb450ee8-6421-4679-b314-b9ea7a50f2c8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:25 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b Nov 05 22:20:25 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:25 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b" returned: 0 in 0.558s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:25 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b Nov 05 22:20:25 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:25 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ae002fe2-5646-463b-880e-7ff92e02080b" returned: 0 in 0.389s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Lock "cinder-quobyte-ae002fe2-5646-463b-880e-7ff92e02080b" released by "delete_volume" :: held 1.013s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:25 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Created reservations ['afca09a4-fd95-4aba-be23-7b4a87505663', 'c1322de7-1d81-42a9-bd3d-993a806202e3', '9198c9da-2221-45d6-94b1-0355764ee507', '31c8e302-346a-42c2-b07d-afe88b0db839'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:26 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:26 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:26 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.316s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Deleted volume successfully. Nov 05 22:20:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0277b022-d275-4560-8d0e-788bbc75a18f tempest-VolumesActionsTest-242220448 None] Lock "cinder-ae002fe2-5646-463b-880e-7ff92e02080b-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Flow 'volume_create_manager' (f968e083-4945-484d-8fa8-b412145445bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702984e6-f967-4546-8ff2-3c1fed040ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702984e6-f967-4546-8ff2-3c1fed040ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901330845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd959ec9-2698-4bd3-8ff4-19c792458f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f4d41b8194b4d8d701a69c2e1962a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:30Z,use_quota=True,user_id='8faf3e161e5a47cf8880f193f243d0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9258726a-2afe-4148-b954-b1be54ec5ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9258726a-2afe-4148-b954-b1be54ec5ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6eee65-d3a5-48a1-99cd-4e5d0ea65be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6eee65-d3a5-48a1-99cd-4e5d0ea65be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd959ec9-2698-4bd3-8ff4-19c792458f99', 'volume_name': 'volume-dd959ec9-2698-4bd3-8ff4-19c792458f99', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95264010-8e11-4d15-99d5-c47ccebd1c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95264010-8e11-4d15-99d5-c47ccebd1c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fdbaed-c320-43fb-b1cd-421900b78d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:30 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Volume dd959ec9-2698-4bd3-8ff4-19c792458f99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd959ec9-2698-4bd3-8ff4-19c792458f99', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Trying to clone dd959ec9-2698-4bd3-8ff4-19c792458f99 from image 7f51a389-75a1-4170-8607-9bba700950bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:20:30 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:20:30 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[77446247-04b7-4607-8538-3c0729a20327]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:31 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD Nov 05 22:20:31 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:31 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc is fetched for user 8faf3e161e5a47cf8880f193f243d0ac. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=108,cinder:UPDATE=113,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=101,cinder:UPDATE=117,cinder:INSERT=38,cinder:DELETE=8 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d0122d-e947-4555-ae8c-de8cf0d0a40f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:31 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD Nov 05 22:20:31 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Flow 'volume_create_manager' (44e6b193-6b5e-49eb-abd1-18f998dae837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4de7535-5115-4140-950a-8c695e52d209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4de7535-5115-4140-950a-8c695e52d209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-555668807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4b4fcc-a345-4760-ba28-aee95999c37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b607c37d8141329bccaf07a5abf0bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:32Z,use_quota=True,user_id='aba135076a3846fcaa82b02a89a6c8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5a9d8b-e338-4220-add2-14896e3f2edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5a9d8b-e338-4220-add2-14896e3f2edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938d2d87-9ab2-42de-a13e-5b88f07bad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938d2d87-9ab2-42de-a13e-5b88f07bad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4b4fcc-a345-4760-ba28-aee95999c37c', 'volume_name': 'volume-fe4b4fcc-a345-4760-ba28-aee95999c37c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f619885-7b66-4086-8f26-cb22dc91097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f619885-7b66-4086-8f26-cb22dc91097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d801ac88-7edf-4dd0-a01d-d63edefbf590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Volume fe4b4fcc-a345-4760-ba28-aee95999c37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4b4fcc-a345-4760-ba28-aee95999c37c', 'volume_size': 1} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-555668807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4b4fcc-a345-4760-ba28-aee95999c37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b607c37d8141329bccaf07a5abf0bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:32Z,use_quota=True,user_id='aba135076a3846fcaa82b02a89a6c8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Creating volume fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:31 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:31 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c 1073741824 Nov 05 22:20:31 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:31 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:32 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c 1073741824" returned: 0 in 0.579s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:32 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c Nov 05 22:20:32 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:32 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c" returned: 0 in 0.271s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901330845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd959ec9-2698-4bd3-8ff4-19c792458f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698f4d41b8194b4d8d701a69c2e1962a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:30Z,use_quota=True,user_id='8faf3e161e5a47cf8880f193f243d0ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Creating volume dd959ec9-2698-4bd3-8ff4-19c792458f99 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:32 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:32 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 1073741824 Nov 05 22:20:32 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d801ac88-7edf-4dd0-a01d-d63edefbf590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4b4fcc-a345-4760-ba28-aee95999c37c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2455e098-2a27-44ea-8567-7117fb93c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Volume volume-fe4b4fcc-a345-4760-ba28-aee95999c37c (fe4b4fcc-a345-4760-ba28-aee95999c37c): created successfully Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2455e098-2a27-44ea-8567-7117fb93c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Flow 'volume_create_manager' (44e6b193-6b5e-49eb-abd1-18f998dae837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7569547d-ac95-47d5-9deb-654777746e9b tempest-VolumesCloneTest-187879768 None] Created volume successfully. Nov 05 22:20:33 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 1073741824" returned: 0 in 0.523s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:33 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 Nov 05 22:20:33 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:33 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Attempting download of 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume dd959ec9-2698-4bd3-8ff4-19c792458f99. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0285ff47-07a7-4a5a-b093-62311af57a6f]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_cycz0pnh {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:33 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_cycz0pnh Nov 05 22:20:33 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:33 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_cycz0pnh" returned: 0 in 0.384s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_cycz0pnh {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:34 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_cycz0pnh Nov 05 22:20:34 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:34 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_cycz0pnh" returned: 1 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_cycz0pnh' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29ac1e-b24c-4975-a975-6720f98b04b9]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Flow 'volume_create_manager' (2f3b10f8-d2f5-444e-92d5-49539b27d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5a992a-acae-407b-af7b-571e8c0f133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5a992a-acae-407b-af7b-571e8c0f133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1476296717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb0a95c-9614-4429-9468-a24c143287d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b607c37d8141329bccaf07a5abf0bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fe4b4fcc-a345-4760-ba28-aee95999c37c,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:34Z,use_quota=True,user_id='aba135076a3846fcaa82b02a89a6c8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af91167f-7376-4adc-aab1-3e3c067b03a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af91167f-7376-4adc-aab1-3e3c067b03a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:34 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15cd7b3-1c6f-4675-a78e-345156c5076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:34 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15cd7b3-1c6f-4675-a78e-345156c5076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1fb0a95c-9614-4429-9468-a24c143287d0', 'volume_name': 'volume-1fb0a95c-9614-4429-9468-a24c143287d0', 'volume_size': 2, 'source_volid': 'fe4b4fcc-a345-4760-ba28-aee95999c37c', 'source_volstatus': 'available'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910645a5-6649-439b-8b6f-f8cc5acfc405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910645a5-6649-439b-8b6f-f8cc5acfc405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2660d49-b471-4bdd-981c-737594e72daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:34 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Volume 1fb0a95c-9614-4429-9468-a24c143287d0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1fb0a95c-9614-4429-9468-a24c143287d0', 'volume_size': 2, 'source_volid': 'fe4b4fcc-a345-4760-ba28-aee95999c37c', 'source_volstatus': 'available'} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:34 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Cloning volume fe4b4fcc-a345-4760-ba28-aee95999c37c to volume 1fb0a95c-9614-4429-9468-a24c143287d0 Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Creating offline snapshot b3c166de-e9f1-44e5-9cfe-713209f71263 of volume fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6a29ab-1a41-4ace-8b5f-7a0be68a224b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:34 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c Nov 05 22:20:34 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:34 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] 7f51a389-75a1-4170-8607-9bba700950bc was qcow2, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:20:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:34 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 Nov 05 22:20:34 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:35 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c" returned: 0 in 0.460s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:35 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 1G Nov 05 22:20:35 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:35 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 1G" returned: 0 in 0.583s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4b4fcc-a345-4760-ba28-aee95999c37c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:35 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4b4fcc-a345-4760-ba28-aee95999c37c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 Nov 05 22:20:35 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:36 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4b4fcc-a345-4760-ba28-aee95999c37c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263" returned: 0 in 0.505s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:36 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 is being set with open permissions: ugo+rw Nov 05 22:20:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:36 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 Nov 05 22:20:36 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:36 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263" returned: 0 in 0.378s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:36 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.info Nov 05 22:20:36 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:36 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.info" returned: 0 in 0.345s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:36 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.info is being set with open permissions: ugo+rw Nov 05 22:20:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:36 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.info Nov 05 22:20:36 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:37 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99" returned: 0 in 2.513s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fb3se9k7devstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:20:37 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Converted 112.00 MB image at 44.53 MB/s Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:37 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 1G Nov 05 22:20:37 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:37 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.info" returned: 0 in 0.453s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Acquiring lock "cinder-quobyte-1fb0a95c-9614-4429-9468-a24c143287d0" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-1fb0a95c-9614-4429-9468-a24c143287d0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] snapshot: b3c166de-e9f1-44e5-9cfe-713209f71263, volume: 1fb0a95c-9614-4429-9468-a24c143287d0, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefd6128-2aff-4256-8e26-2d5e8296394a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:37 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 Nov 05 22:20:37 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:37 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 1G" returned: 0 in 0.426s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Downloaded image 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume dd959ec9-2698-4bd3-8ff4-19c792458f99 successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc for user 8faf3e161e5a47cf8880f193f243d0ac is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Marking volume dd959ec9-2698-4bd3-8ff4-19c792458f99 as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Copying metadata from image 7f51a389-75a1-4170-8607-9bba700950bc to dd959ec9-2698-4bd3-8ff4-19c792458f99. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Creating volume glance metadata for volume dd959ec9-2698-4bd3-8ff4-19c792458f99 backed by image 7f51a389-75a1-4170-8607-9bba700950bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fdbaed-c320-43fb-b1cd-421900b78d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd959ec9-2698-4bd3-8ff4-19c792458f99', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9456ecb4-0a82-47f8-a633-f41a9c608882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Volume volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 (dd959ec9-2698-4bd3-8ff4-19c792458f99): created successfully Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9456ecb4-0a82-47f8-a633-f41a9c608882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Flow 'volume_create_manager' (f968e083-4945-484d-8fa8-b412145445bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:37 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263" returned: 0 in 0.437s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4b4fcc-a345-4760-ba28-aee95999c37c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e1ef9c93-b016-4006-a48d-f70474ba9101 tempest-ServerActionsTestOtherA-197608559 None] Created volume successfully. Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[258a3f2f-0684-4ab6-a119-598d09f1c727]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:38 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c Nov 05 22:20:38 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:38 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c" returned: 0 in 0.432s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:20:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:20:38 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:20:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:38 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 Nov 05 22:20:38 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Flow 'volume_create_manager' (ade6ddf4-59eb-44f7-841f-e1b525317a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9bbe53-9121-4859-9993-f8aae142eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9bbe53-9121-4859-9993-f8aae142eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-292554729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bf1611-11bf-454a-baed-73e24218f295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34aded1f0ee045b782aa9a85eab172d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:40Z,use_quota=True,user_id='cbb9e7a150ea4433be12238b08158273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8b6c74-1f90-4fe5-8de5-f88b38c25f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea8b6c74-1f90-4fe5-8de5-f88b38c25f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b96f68a-3722-418b-a53f-4c8da84a6fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b96f68a-3722-418b-a53f-4c8da84a6fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bf1611-11bf-454a-baed-73e24218f295', 'volume_name': 'volume-42bf1611-11bf-454a-baed-73e24218f295', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d58764e-6c00-4c90-ad8e-cb219d184721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d58764e-6c00-4c90-ad8e-cb219d184721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57ff27c-dd3b-4a52-877a-4755c16995a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:39 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Volume 42bf1611-11bf-454a-baed-73e24218f295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bf1611-11bf-454a-baed-73e24218f295', 'volume_size': 1} Nov 05 22:20:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:40 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:40 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:40 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.643s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:20:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:20:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8ea72d2d-2e2b-46a1-a3bd-98e4dc026be7 req-42ecbd35-2e2f-4334-a503-8745bdc462fb tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:47 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0" returned: 0 in 9.408s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:47 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:20:47 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Converted 1024.00 MB image at 108.83 MB/s Nov 05 22:20:47 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 is being set with open permissions: ugo+rw Nov 05 22:20:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:47 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 Nov 05 22:20:47 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:48 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0" returned: 0 in 0.314s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-1fb0a95c-9614-4429-9468-a24c143287d0" released by "_copy_volume_from_snapshot" :: held 10.703s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Acquiring lock "cinder-quobyte-b3c166de-e9f1-44e5-9cfe-713209f71263" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Flow 'volume_create_manager' (294c0ff3-1c44-46cb-9ebd-ef3f9f6d7f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea37dd97-56bd-45e7-86bd-de5f9f7580ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-b3c166de-e9f1-44e5-9cfe-713209f71263" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Deleting offline snapshot b3c166de-e9f1-44e5-9cfe-713209f71263 of volume fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] snapshot_file for this snap is: volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea37dd97-56bd-45e7-86bd-de5f9f7580ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1728942278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2a94ce-ec05-4890-9879-01763dbb7368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932b0d5a4b0449daeb10468b2d6392d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:48Z,use_quota=True,user_id='45105151788949da868a4380b39ddbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43458e04-3a07-44cd-bf66-5d0a847e0526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43458e04-3a07-44cd-bf66-5d0a847e0526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09669884-847b-4939-841a-80464afdc91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09669884-847b-4939-841a-80464afdc91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2a94ce-ec05-4890-9879-01763dbb7368', 'volume_name': 'volume-ba2a94ce-ec05-4890-9879-01763dbb7368', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d350d1e-6059-4c84-8228-438851027682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d350d1e-6059-4c84-8228-438851027682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7cdf35-b5c9-443b-9933-c2bf1317357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:48 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Volume ba2a94ce-ec05-4890-9879-01763dbb7368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2a94ce-ec05-4890-9879-01763dbb7368', 'volume_size': 1} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[45211170-b31d-4899-afa9-f5d3a1e5694c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:48 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 Nov 05 22:20:48 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:48 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263" returned: 0 in 0.372s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4b4fcc-a345-4760-ba28-aee95999c37c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e07bc8-8784-424c-954f-913d147acd25]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:48 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c Nov 05 22:20:48 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:49 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c" returned: 0 in 0.536s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:49 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 Nov 05 22:20:49 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:49 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263" returned: 0 in 0.333s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:49 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263 Nov 05 22:20:49 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:49 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c.b3c166de-e9f1-44e5-9cfe-713209f71263" returned: 0 in 0.241s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-b3c166de-e9f1-44e5-9cfe-713209f71263" released by "_delete_snapshot" :: held 1.614s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.326s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-292554729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bf1611-11bf-454a-baed-73e24218f295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34aded1f0ee045b782aa9a85eab172d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:40Z,use_quota=True,user_id='cbb9e7a150ea4433be12238b08158273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Creating volume 42bf1611-11bf-454a-baed-73e24218f295 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:49 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:49 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 1073741824 Nov 05 22:20:49 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2660d49-b471-4bdd-981c-737594e72daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb0a95c-9614-4429-9468-a24c143287d0', 'volume_size': 2, 'source_volid': 'fe4b4fcc-a345-4760-ba28-aee95999c37c', 'source_volstatus': 'available'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d1ec2f-ce19-4916-a666-8853a72b76ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Volume volume-1fb0a95c-9614-4429-9468-a24c143287d0 (1fb0a95c-9614-4429-9468-a24c143287d0): created successfully Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d1ec2f-ce19-4916-a666-8853a72b76ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Flow 'volume_create_manager' (2f3b10f8-d2f5-444e-92d5-49539b27d380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b83dce1b-f016-4bcb-a398-24e97780c006 tempest-VolumesCloneTest-187879768 None] Created volume successfully. Nov 05 22:20:50 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 1073741824" returned: 0 in 0.488s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:50 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 Nov 05 22:20:50 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Acquiring lock "cinder-1fb0a95c-9614-4429-9468-a24c143287d0-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Lock "cinder-1fb0a95c-9614-4429-9468-a24c143287d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Acquiring lock "cinder-quobyte-1fb0a95c-9614-4429-9468-a24c143287d0" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-1fb0a95c-9614-4429-9468-a24c143287d0" acquired by "delete_volume" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6612746c-0761-4337-969b-a9ffc14e69d0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:50 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295" returned: 0 in 0.250s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8ea72d2d-2e2b-46a1-a3bd-98e4dc026be7 req-42ecbd35-2e2f-4334-a503-8745bdc462fb tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.025s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57ff27c-dd3b-4a52-877a-4755c16995a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bf1611-11bf-454a-baed-73e24218f295', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d833bff-ea44-451b-8832-908bb901f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8ea72d2d-2e2b-46a1-a3bd-98e4dc026be7 req-42ecbd35-2e2f-4334-a503-8745bdc462fb tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.443s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1728942278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba2a94ce-ec05-4890-9879-01763dbb7368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932b0d5a4b0449daeb10468b2d6392d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:48Z,use_quota=True,user_id='45105151788949da868a4380b39ddbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Creating volume ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:50 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:50 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Volume volume-42bf1611-11bf-454a-baed-73e24218f295 (42bf1611-11bf-454a-baed-73e24218f295): created successfully Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d833bff-ea44-451b-8832-908bb901f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:50 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 1073741824 Nov 05 22:20:50 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Flow 'volume_create_manager' (ade6ddf4-59eb-44f7-841f-e1b525317a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:50 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 Nov 05 22:20:50 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4763c7b7-e493-4436-829f-83ecfffcb4ff tempest-AttachVolumeTestJSON-1488034404 None] Created volume successfully. Nov 05 22:20:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-8ea72d2d-2e2b-46a1-a3bd-98e4dc026be7 req-42ecbd35-2e2f-4334-a503-8745bdc462fb tempest-ServerActionsTestOtherA-197608559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-dd959ec9-2698-4bd3-8ff4-19c792458f99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbaf636d-09d2-4d92-a128-4bb895dff472', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:20:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-8ea72d2d-2e2b-46a1-a3bd-98e4dc026be7 req-42ecbd35-2e2f-4334-a503-8745bdc462fb tempest-ServerActionsTestOtherA-197608559 None] attachment_update completed successfully. Nov 05 22:20:51 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0" returned: 0 in 0.400s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:51 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0 Nov 05 22:20:51 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:51 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 1073741824" returned: 0 in 0.558s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:51 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 Nov 05 22:20:51 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:51 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1fb0a95c-9614-4429-9468-a24c143287d0" returned: 0 in 0.335s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-1fb0a95c-9614-4429-9468-a24c143287d0" released by "delete_volume" :: held 0.789s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Created reservations ['e6da8b72-05d6-474c-8637-8f90b78defd7', '20ffabee-d48e-4247-9730-4380d0997dae', '5c242565-c3ad-41ab-ba6c-419cad043094', 'f848d8e8-8240-46cf-93e4-4afcc983faa4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:51 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:51 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:51 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368" returned: 0 in 0.437s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7cdf35-b5c9-443b-9933-c2bf1317357d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2a94ce-ec05-4890-9879-01763dbb7368', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399f26c3-7f6f-4d57-be69-900440db5a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Volume volume-ba2a94ce-ec05-4890-9879-01763dbb7368 (ba2a94ce-ec05-4890-9879-01763dbb7368): created successfully Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399f26c3-7f6f-4d57-be69-900440db5a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Flow 'volume_create_manager' (294c0ff3-1c44-46cb-9ebd-ef3f9f6d7f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Acquiring lock "cinder-fe4b4fcc-a345-4760-ba28-aee95999c37c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-89f90a0b-ce80-4df8-a3e2-9d26b6b985ec tempest-VolumesDeleteCascade-207450447 None] Created volume successfully. Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Lock "cinder-fe4b4fcc-a345-4760-ba28-aee95999c37c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Acquiring lock "cinder-quobyte-fe4b4fcc-a345-4760-ba28-aee95999c37c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-fe4b4fcc-a345-4760-ba28-aee95999c37c" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:20:52 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.545s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Deleted volume successfully. Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d722b152-5bbe-4f29-977d-2c3f717c2a79]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b7c7b9d-d3ea-4f71-a99e-3cb026405754 tempest-VolumesCloneTest-187879768 None] Lock "cinder-1fb0a95c-9614-4429-9468-a24c143287d0-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:52 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c Nov 05 22:20:52 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Creating offline snapshot b63d3109-0ce0-45e1-ae14-144d9a51ad80 of volume ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83510a2-a254-4a2f-b597-ed957df2d950]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:52 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c" returned: 0 in 0.749s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c Nov 05 22:20:53 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 Nov 05 22:20:53 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-12fe45df-fa0d-4aa4-ac7b-ef24fdc26e23 req-a9c8585c-fc52-4e58-9a38-0fe8036fef6a tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:53 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fe4b4fcc-a345-4760-ba28-aee95999c37c" returned: 0 in 0.429s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Lock "cinder-quobyte-fe4b4fcc-a345-4760-ba28-aee95999c37c" released by "delete_volume" :: held 1.288s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:53 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368" returned: 0 in 0.511s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 1G Nov 05 22:20:53 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Created reservations ['52dd3096-1d17-46c6-be6c-d675c2059b92', '7a352f97-104b-4470-84bf-ed129a89ae3c', '6e483610-2a7d-4b49-8894-9728aefd301f', 'a357cc10-5820-4362-a8a9-81092a1cc00a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:53 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:20:53 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:53 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.285s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:20:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Deleted volume successfully. Nov 05 22:20:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfad55b0-57a6-48b0-8697-55a9402adccb tempest-VolumesCloneTest-187879768 None] Lock "cinder-fe4b4fcc-a345-4760-ba28-aee95999c37c-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:20:54 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 1G" returned: 0 in 0.604s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2a94ce-ec05-4890-9879-01763dbb7368 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:54 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2a94ce-ec05-4890-9879-01763dbb7368 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 Nov 05 22:20:54 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:54 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2a94ce-ec05-4890-9879-01763dbb7368 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80" returned: 0 in 0.387s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:54 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 is being set with open permissions: ugo+rw Nov 05 22:20:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:54 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 Nov 05 22:20:54 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:54 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80" returned: 0 in 0.401s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:54 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.info Nov 05 22:20:54 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:55 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.info" returned: 0 in 0.314s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:55 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.info is being set with open permissions: ugo+rw Nov 05 22:20:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:55 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.info Nov 05 22:20:55 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:55 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.info" returned: 0 in 0.259s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-12fe45df-fa0d-4aa4-ac7b-ef24fdc26e23 req-a9c8585c-fc52-4e58-9a38-0fe8036fef6a tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.217s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-12fe45df-fa0d-4aa4-ac7b-ef24fdc26e23 req-a9c8585c-fc52-4e58-9a38-0fe8036fef6a tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2c2f00f9-acb0-4b14-b2ed-5116c9572f88 tempest-VolumesDeleteCascade-207450447 None] Create snapshot completed successfully Nov 05 22:20:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-12fe45df-fa0d-4aa4-ac7b-ef24fdc26e23 req-a9c8585c-fc52-4e58-9a38-0fe8036fef6a tempest-AttachVolumeTestJSON-1488034404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-42bf1611-11bf-454a-baed-73e24218f295', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7b7be16-43a2-466b-8b65-bf05eeb00dcc', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:20:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-12fe45df-fa0d-4aa4-ac7b-ef24fdc26e23 req-a9c8585c-fc52-4e58-9a38-0fe8036fef6a tempest-AttachVolumeTestJSON-1488034404 None] attachment_update completed successfully. Nov 05 22:20:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Creating offline snapshot 4a65d9fe-5975-4141-af0c-824048b3bd85 of volume ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:20:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6c9d29-165d-4f6b-938f-62895be94a92]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:20:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:56 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 Nov 05 22:20:56 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:57 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80" returned: 0 in 0.569s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2a94ce-ec05-4890-9879-01763dbb7368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:20:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:57 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 1G Nov 05 22:20:57 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:58 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 1G" returned: 0 in 0.883s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:58 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 Nov 05 22:20:58 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:58 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85" returned: 0 in 0.632s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:58 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 is being set with open permissions: ugo+rw Nov 05 22:20:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:58 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 Nov 05 22:20:58 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Flow 'volume_create_manager' (b1d36424-312f-4157-a687-a6c1d7be5dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed5de07-75a0-4636-a46f-f2f627581c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed5de07-75a0-4636-a46f-f2f627581c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-258888778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eec7c2d-072d-44af-990e-3cd2f0f859fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34aded1f0ee045b782aa9a85eab172d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:59Z,use_quota=True,user_id='cbb9e7a150ea4433be12238b08158273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7335d35d-4c82-4dd5-b48c-dda76bfdf7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7335d35d-4c82-4dd5-b48c-dda76bfdf7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52806be-14e0-410b-b336-27130037424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d52806be-14e0-410b-b336-27130037424c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eec7c2d-072d-44af-990e-3cd2f0f859fd', 'volume_name': 'volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd145c08-2230-4666-af40-eef31c15e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd145c08-2230-4666-af40-eef31c15e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97103edd-dd33-4174-bce1-a2ac2b62b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:20:59 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Volume 7eec7c2d-072d-44af-990e-3cd2f0f859fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd', 'volume_size': 1} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:59 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85" returned: 0 in 0.523s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.907s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-258888778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eec7c2d-072d-44af-990e-3cd2f0f859fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34aded1f0ee045b782aa9a85eab172d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:20:59Z,use_quota=True,user_id='cbb9e7a150ea4433be12238b08158273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Creating volume 7eec7c2d-072d-44af-990e-3cd2f0f859fd {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:20:59 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:20:59 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd 1073741824 Nov 05 22:20:59 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:20:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-327cc789-b596-4f8d-ab53-f356ec4f7c32 tempest-VolumesDeleteCascade-207450447 None] Create snapshot completed successfully Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-ba2a94ce-ec05-4890-9879-01763dbb7368-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:20:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-ba2a94ce-ec05-4890-9879-01763dbb7368-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Performing cascade delete. {{(pid=87085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-4a65d9fe-5975-4141-af0c-824048b3bd85-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-4a65d9fe-5975-4141-af0c-824048b3bd85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-4a65d9fe-5975-4141-af0c-824048b3bd85" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-4a65d9fe-5975-4141-af0c-824048b3bd85" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Deleting offline snapshot 4a65d9fe-5975-4141-af0c-824048b3bd85 of volume ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] snapshot_file for this snap is: volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea71354-9dc4-4156-824c-4bf6b942e4e7]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:00 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 Nov 05 22:21:00 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:00 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd 1073741824" returned: 0 in 1.252s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:00 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd Nov 05 22:21:00 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:00 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85" returned: 0 in 0.625s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2a94ce-ec05-4890-9879-01763dbb7368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f0379-bc08-4b65-8f7c-78485632b85a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:01 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 Nov 05 22:21:01 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:01 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd" returned: 0 in 0.537s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97103edd-dd33-4174-bce1-a2ac2b62b16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf6a3d9-7417-44b8-b35d-d7d97ef4adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:01 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Volume volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd (7eec7c2d-072d-44af-990e-3cd2f0f859fd): created successfully Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf6a3d9-7417-44b8-b35d-d7d97ef4adb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:01 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Flow 'volume_create_manager' (b1d36424-312f-4157-a687-a6c1d7be5dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80" returned: 0 in 0.544s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2a94ce-ec05-4890-9879-01763dbb7368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c5471fee-b738-4a40-accc-fad7b11c0f25 tempest-AttachVolumeTestJSON-1488034404 None] Created volume successfully. Nov 05 22:21:01 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 Nov 05 22:21:01 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:02 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85" returned: 0 in 0.600s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:02 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85 Nov 05 22:21:02 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Flow 'volume_create_manager' (e8f4b1b2-8da9-470b-9e39-e7b71c63f346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e9478d-87de-437d-9b68-ceff89bb4005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e9478d-87de-437d-9b68-ceff89bb4005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1398262010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa86f77a-287e-404f-b465-bf896251d7c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87e045959ec34794a6b0e393b3e171a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:02Z,use_quota=True,user_id='71c6e15cd54349e4bc8394bafcb9765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b866499-58b1-4912-9600-6cbe5a2809d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b866499-58b1-4912-9600-6cbe5a2809d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258b7ca8-b98f-4e21-8e1e-e2912081ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258b7ca8-b98f-4e21-8e1e-e2912081ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa86f77a-287e-404f-b465-bf896251d7c0', 'volume_name': 'volume-fa86f77a-287e-404f-b465-bf896251d7c0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24adf77a-6e07-4988-93ae-1291d3834601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24adf77a-6e07-4988-93ae-1291d3834601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffb0e82-d7b1-49a0-a728-9cac4dc787d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Volume fa86f77a-287e-404f-b465-bf896251d7c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa86f77a-287e-404f-b465-bf896251d7c0', 'volume_size': 1} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1398262010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa86f77a-287e-404f-b465-bf896251d7c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87e045959ec34794a6b0e393b3e171a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:02Z,use_quota=True,user_id='71c6e15cd54349e4bc8394bafcb9765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Creating volume fa86f77a-287e-404f-b465-bf896251d7c0 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:02 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:02 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.4a65d9fe-5975-4141-af0c-824048b3bd85" returned: 0 in 0.381s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:02 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 1073741824 Nov 05 22:21:02 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-4a65d9fe-5975-4141-af0c-824048b3bd85" released by "_delete_snapshot" :: held 2.342s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" released by "delete_snapshot" :: held 2.384s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Created reservations ['f1e7dcb6-00ef-4701-b3c0-eb4b1df559a0', 'a8a67f32-1595-4b89-9a62-89c3ecdaf5e0', '7b9dbe3d-2ca6-42c2-88a9-4813a7bf25a3', '935b5fc9-40d1-4f3a-a91f-be0ed66b0fc9'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Delete snapshot completed successfully. Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-4a65d9fe-5975-4141-af0c-824048b3bd85-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-b63d3109-0ce0-45e1-ae14-144d9a51ad80-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-b63d3109-0ce0-45e1-ae14-144d9a51ad80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-b63d3109-0ce0-45e1-ae14-144d9a51ad80" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-b63d3109-0ce0-45e1-ae14-144d9a51ad80" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Deleting offline snapshot b63d3109-0ce0-45e1-ae14-144d9a51ad80 of volume ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] snapshot_file for this snap is: volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce7a98d-1193-46e2-911e-45efdbec8761]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:03 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 Nov 05 22:21:03 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:03 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 1073741824" returned: 0 in 1.017s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:03 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 Nov 05 22:21:03 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:03 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80" returned: 0 in 0.696s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2a94ce-ec05-4890-9879-01763dbb7368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f693cfa9-e9ec-4ef1-863d-a2bf828115cf]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:04 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0" returned: 0 in 0.503s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffb0e82-d7b1-49a0-a728-9cac4dc787d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa86f77a-287e-404f-b465-bf896251d7c0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904211e7-4d91-45d0-999d-bd2b7911c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:04 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Volume volume-fa86f77a-287e-404f-b465-bf896251d7c0 (fa86f77a-287e-404f-b465-bf896251d7c0): created successfully Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904211e7-4d91-45d0-999d-bd2b7911c136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Flow 'volume_create_manager' (e8f4b1b2-8da9-470b-9e39-e7b71c63f346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:04 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 Nov 05 22:21:04 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-596f1667-2b04-4ff7-99be-8944a60f200a tempest-VolumesListTestJSON-919478158 None] Created volume successfully. Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-35714a69-913f-47f1-b01a-251577b5febe req-892c092b-d439-43ab-bebf-d7b05964ebe2 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-35714a69-913f-47f1-b01a-251577b5febe req-892c092b-d439-43ab-bebf-d7b05964ebe2 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-35714a69-913f-47f1-b01a-251577b5febe req-892c092b-d439-43ab-bebf-d7b05964ebe2 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-35714a69-913f-47f1-b01a-251577b5febe req-892c092b-d439-43ab-bebf-d7b05964ebe2 tempest-AttachVolumeTestJSON-1488034404 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb7848e5-f329-4bc4-a5b7-601a6706f982', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:21:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-35714a69-913f-47f1-b01a-251577b5febe req-892c092b-d439-43ab-bebf-d7b05964ebe2 tempest-AttachVolumeTestJSON-1488034404 None] attachment_update completed successfully. Nov 05 22:21:04 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368" returned: 0 in 0.728s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:04 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 Nov 05 22:21:04 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:05 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80" returned: 0 in 0.679s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:05 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80 Nov 05 22:21:05 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Flow 'volume_create_manager' (811afe85-78f6-4da5-99af-4464ae76e904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e351a3-c628-490c-8a96-ed69f9855272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e351a3-c628-490c-8a96-ed69f9855272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-172608504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b27aa2-6536-4067-9d3d-b233ae8c25f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87e045959ec34794a6b0e393b3e171a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:05Z,use_quota=True,user_id='71c6e15cd54349e4bc8394bafcb9765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19967c91-9441-49ea-98f0-fdd8a821d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19967c91-9441-49ea-98f0-fdd8a821d935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc0a5d8-daa3-455a-9037-50d2c29ed999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc0a5d8-daa3-455a-9037-50d2c29ed999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b27aa2-6536-4067-9d3d-b233ae8c25f8', 'volume_name': 'volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d1d281-dc26-4a14-b0b2-65a8c04b9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d1d281-dc26-4a14-b0b2-65a8c04b9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f555916-054a-4099-9b97-5b985ece529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Volume 25b27aa2-6536-4067-9d3d-b233ae8c25f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8', 'volume_size': 1} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-172608504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b27aa2-6536-4067-9d3d-b233ae8c25f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87e045959ec34794a6b0e393b3e171a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:05Z,use_quota=True,user_id='71c6e15cd54349e4bc8394bafcb9765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Creating volume 25b27aa2-6536-4067-9d3d-b233ae8c25f8 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:05 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:05 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 1073741824 Nov 05 22:21:05 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:05 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368.b63d3109-0ce0-45e1-ae14-144d9a51ad80" returned: 0 in 0.452s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-b63d3109-0ce0-45e1-ae14-144d9a51ad80" released by "_delete_snapshot" :: held 2.811s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" released by "delete_snapshot" :: held 2.905s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Created reservations ['60cac7e0-b364-4477-8206-993e31ed6a28', '2ed4d3c5-5a00-4813-b406-52c90be15ea0', '99937371-f942-4ea2-bb88-8b315de63752', 'fbd6e2f5-6903-480e-9d81-8ca9e4a73d3b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Delete snapshot completed successfully. Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-b63d3109-0ce0-45e1-ae14-144d9a51ad80-delete_snapshot" released by "delete_snapshot" :: held 3.155s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Snapshots deleted, issuing volume delete {{(pid=87085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96a0898-5f5b-4696-8e99-58989f21773d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:06 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 1073741824" returned: 0 in 0.566s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:06 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 Nov 05 22:21:06 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:06 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 Nov 05 22:21:06 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:06 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-55a05e11-cc45-4e04-b9f5-806bedfafb72 req-5adf762d-136c-483d-8ac7-0f17e7e3fb47 tempest-ServerActionsTestOtherA-197608559 None] Terminate volume connection completed successfully. Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-55a05e11-cc45-4e04-b9f5-806bedfafb72 req-5adf762d-136c-483d-8ac7-0f17e7e3fb47 tempest-ServerActionsTestOtherA-197608559 None] Deleting attachment cbaf636d-09d2-4d92-a128-4bb895dff472. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368" returned: 0 in 0.712s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:06 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368 Nov 05 22:21:06 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:07 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8" returned: 0 in 0.651s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f555916-054a-4099-9b97-5b985ece529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef155423-7cdf-40ad-bf05-91dda1a010ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:07 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Volume volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 (25b27aa2-6536-4067-9d3d-b233ae8c25f8): created successfully Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef155423-7cdf-40ad-bf05-91dda1a010ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Flow 'volume_create_manager' (811afe85-78f6-4da5-99af-4464ae76e904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-32a910b1-cb2d-453e-9dc8-edba061d549d tempest-VolumesListTestJSON-919478158 None] Created volume successfully. Nov 05 22:21:07 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ba2a94ce-ec05-4890-9879-01763dbb7368" returned: 0 in 0.422s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-ba2a94ce-ec05-4890-9879-01763dbb7368" released by "delete_volume" :: held 1.243s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Created reservations ['c8fb0a3a-997e-4a59-9f21-f8bfae8484f6', 'c72f446f-a0e4-4049-8024-5b77286db80c', 'c2c7fc8a-cffc-43d0-8b96-0531a69856e3', 'dd4753ff-0261-431c-87ce-bca57e80495d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:07 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:07 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:07 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.403s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Deleted volume successfully. Nov 05 22:21:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-8b45281c-485a-4987-bd71-1b9c60ed01d6 req-20987b28-55dd-4075-bda5-b00535e65d8c tempest-AttachVolumeTestJSON-1488034404 None] Terminate volume connection completed successfully. Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-8b45281c-485a-4987-bd71-1b9c60ed01d6 req-20987b28-55dd-4075-bda5-b00535e65d8c tempest-AttachVolumeTestJSON-1488034404 None] Deleting attachment b7b7be16-43a2-466b-8b65-bf05eeb00dcc. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e7f281da-9630-4c5e-b73b-a5e6f0818080 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-ba2a94ce-ec05-4890-9879-01763dbb7368-delete_volume" released by "delete_volume" :: held 8.074s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Flow 'volume_create_manager' (8cf850a9-ce74-46b2-81b6-110d13e39502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61b6e6-b951-4fc4-9a5d-5f8ccd157a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61b6e6-b951-4fc4-9a5d-5f8ccd157a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-193810818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772f72df-2fcf-4e72-a7a4-5b355646b47c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87e045959ec34794a6b0e393b3e171a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:08Z,use_quota=True,user_id='71c6e15cd54349e4bc8394bafcb9765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecdef7d-5678-4186-92b9-322ac8f40666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecdef7d-5678-4186-92b9-322ac8f40666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d993b6e-e314-46db-856f-3c45ebb3961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d993b6e-e314-46db-856f-3c45ebb3961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '772f72df-2fcf-4e72-a7a4-5b355646b47c', 'volume_name': 'volume-772f72df-2fcf-4e72-a7a4-5b355646b47c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438c6a74-387a-46a9-955b-5b3712591394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438c6a74-387a-46a9-955b-5b3712591394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90647c-e8f7-49ef-86ea-3c5dfb991f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:08 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Volume 772f72df-2fcf-4e72-a7a4-5b355646b47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-772f72df-2fcf-4e72-a7a4-5b355646b47c', 'volume_size': 1} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-193810818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=772f72df-2fcf-4e72-a7a4-5b355646b47c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87e045959ec34794a6b0e393b3e171a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:08Z,use_quota=True,user_id='71c6e15cd54349e4bc8394bafcb9765b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Creating volume 772f72df-2fcf-4e72-a7a4-5b355646b47c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:08 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:21:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:08 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c 1073741824 Nov 05 22:21:08 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:09 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c 1073741824" returned: 0 in 0.748s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:09 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c Nov 05 22:21:09 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Flow 'volume_create_manager' (c6e2b07f-3108-4811-8ca3-fa10d911b1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac5e886-8b20-4f12-8ba6-d741bbbd8357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac5e886-8b20-4f12-8ba6-d741bbbd8357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1869355245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afad416d-46c9-4845-ac75-b868f1d90d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932b0d5a4b0449daeb10468b2d6392d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:09Z,use_quota=True,user_id='45105151788949da868a4380b39ddbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adee5073-c2bb-40a1-8084-72c7dc4c8565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adee5073-c2bb-40a1-8084-72c7dc4c8565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73aa9fc-9ec1-41a0-9b49-b52dc09f78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73aa9fc-9ec1-41a0-9b49-b52dc09f78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afad416d-46c9-4845-ac75-b868f1d90d81', 'volume_name': 'volume-afad416d-46c9-4845-ac75-b868f1d90d81', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6c1f15-655f-40d8-ade9-26b8fa921391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6c1f15-655f-40d8-ade9-26b8fa921391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7f7d27-b25b-4a11-9907-c24947ecff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:09 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Volume afad416d-46c9-4845-ac75-b868f1d90d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afad416d-46c9-4845-ac75-b868f1d90d81', 'volume_size': 1} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:09 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1869355245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afad416d-46c9-4845-ac75-b868f1d90d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932b0d5a4b0449daeb10468b2d6392d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:09Z,use_quota=True,user_id='45105151788949da868a4380b39ddbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Creating volume afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:09 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-5e19560b-f4c2-424a-bfbf-6fa8d859e7d5 req-f0cdea99-f3fd-4431-a58d-a5f79d46f920 tempest-AttachVolumeTestJSON-1488034404 None] Terminate volume connection completed successfully. Nov 05 22:21:09 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 1073741824 Nov 05 22:21:09 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-5e19560b-f4c2-424a-bfbf-6fa8d859e7d5 req-f0cdea99-f3fd-4431-a58d-a5f79d46f920 tempest-AttachVolumeTestJSON-1488034404 None] Deleting attachment eb7848e5-f329-4bc4-a5b7-601a6706f982. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90647c-e8f7-49ef-86ea-3c5dfb991f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-772f72df-2fcf-4e72-a7a4-5b355646b47c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cdd850-c618-413a-9823-cf609dc8e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:09 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Volume volume-772f72df-2fcf-4e72-a7a4-5b355646b47c (772f72df-2fcf-4e72-a7a4-5b355646b47c): created successfully Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cdd850-c618-413a-9823-cf609dc8e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Flow 'volume_create_manager' (8cf850a9-ce74-46b2-81b6-110d13e39502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bf164c10-1fca-4f31-b33e-f236002784ca tempest-VolumesListTestJSON-919478158 None] Created volume successfully. Nov 05 22:21:10 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 1073741824" returned: 0 in 0.515s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:10 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 Nov 05 22:21:10 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-55a05e11-cc45-4e04-b9f5-806bedfafb72 req-c4da9f51-47a6-4b44-bfe1-a2a4cd65d428 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:10 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81" returned: 0 in 0.292s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-55a05e11-cc45-4e04-b9f5-806bedfafb72 req-c4da9f51-47a6-4b44-bfe1-a2a4cd65d428 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.260s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7f7d27-b25b-4a11-9907-c24947ecff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afad416d-46c9-4845-ac75-b868f1d90d81', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede238dd-15c9-4f0d-a3b9-02b187fd38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-55a05e11-cc45-4e04-b9f5-806bedfafb72 req-c4da9f51-47a6-4b44-bfe1-a2a4cd65d428 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Volume volume-afad416d-46c9-4845-ac75-b868f1d90d81 (afad416d-46c9-4845-ac75-b868f1d90d81): created successfully Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede238dd-15c9-4f0d-a3b9-02b187fd38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Flow 'volume_create_manager' (c6e2b07f-3108-4811-8ca3-fa10d911b1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0fca5539-f495-402e-9693-e0ecde33a660 tempest-VolumesDeleteCascade-207450447 None] Created volume successfully. Nov 05 22:21:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-55a05e11-cc45-4e04-b9f5-806bedfafb72 req-c4da9f51-47a6-4b44-bfe1-a2a4cd65d428 tempest-ServerActionsTestOtherA-197608559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-dd959ec9-2698-4bd3-8ff4-19c792458f99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d0d3b56-ed49-44ca-827b-a6c789826b10', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:21:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-55a05e11-cc45-4e04-b9f5-806bedfafb72 req-c4da9f51-47a6-4b44-bfe1-a2a4cd65d428 tempest-ServerActionsTestOtherA-197608559 None] attachment_update completed successfully. Nov 05 22:21:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Creating offline snapshot 073f5669-72d5-437e-903d-2903d96e6198 of volume afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:21:12 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ed167b-e323-486b-9573-a168f8e96e95]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:12 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 Nov 05 22:21:12 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:12 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81" returned: 0 in 0.793s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:12 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 1G Nov 05 22:21:12 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:13 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 1G" returned: 0 in 0.738s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afad416d-46c9-4845-ac75-b868f1d90d81 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:13 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afad416d-46c9-4845-ac75-b868f1d90d81 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 Nov 05 22:21:13 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:14 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afad416d-46c9-4845-ac75-b868f1d90d81 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198" returned: 0 in 0.699s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:14 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 is being set with open permissions: ugo+rw Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:14 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 Nov 05 22:21:14 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Acquiring lock "cinder-772f72df-2fcf-4e72-a7a4-5b355646b47c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Lock "cinder-772f72df-2fcf-4e72-a7a4-5b355646b47c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:14 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198" returned: 0 in 0.393s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Acquiring lock "cinder-quobyte-772f72df-2fcf-4e72-a7a4-5b355646b47c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Lock "cinder-quobyte-772f72df-2fcf-4e72-a7a4-5b355646b47c" acquired by "delete_volume" :: waited 0.079s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:14 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.info Nov 05 22:21:14 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c2be35-1e4e-4087-9f9b-7deea769f7ab]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c Nov 05 22:21:15 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.info" returned: 0 in 0.555s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.info is being set with open permissions: ugo+rw Nov 05 22:21:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.info Nov 05 22:21:15 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c" returned: 0 in 0.857s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:15 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c Nov 05 22:21:15 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:15 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.info" returned: 0 in 0.595s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.985s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bc285984-2b9d-4b4f-b8c1-b4845c254719 tempest-VolumesDeleteCascade-207450447 None] Create snapshot completed successfully Nov 05 22:21:16 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-772f72df-2fcf-4e72-a7a4-5b355646b47c" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Lock "cinder-quobyte-772f72df-2fcf-4e72-a7a4-5b355646b47c" released by "delete_volume" :: held 1.393s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Created reservations ['6a225b98-fc84-4a4b-a24e-b5eb1007cb1b', '40edd6ea-af96-4bd6-b16e-21891368c9a7', 'e4a26225-3b98-4cf7-8d78-987cbf6e5c94', '8c2d00f2-66d7-4a3d-8aa2-1cc14da91418'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:16 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:16 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:16 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.412s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Deleted volume successfully. Nov 05 22:21:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f850cea-4c15-4b5c-babe-6a7656556f8e tempest-VolumesListTestJSON-919478158 None] Lock "cinder-772f72df-2fcf-4e72-a7a4-5b355646b47c-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Acquiring lock "cinder-25b27aa2-6536-4067-9d3d-b233ae8c25f8-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-25b27aa2-6536-4067-9d3d-b233ae8c25f8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Acquiring lock "cinder-quobyte-25b27aa2-6536-4067-9d3d-b233ae8c25f8" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-quobyte-25b27aa2-6536-4067-9d3d-b233ae8c25f8" acquired by "delete_volume" :: waited 0.052s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c3f52d-a101-46cb-85ab-c0b67f780892]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Flow 'volume_create_manager' (df221928-09ff-4ef0-94e1-64871e446f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ad617f-5c73-48e2-8bf7-848a18795a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ad617f-5c73-48e2-8bf7-848a18795a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-275017714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300228a3-14f1-4bbd-8078-afa4b9edcd05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9932b0d5a4b0449daeb10468b2d6392d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=073f5669-72d5-437e-903d-2903d96e6198,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:17Z,use_quota=True,user_id='45105151788949da868a4380b39ddbc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d243cf1-fc6a-49b0-8758-c475c620f75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d243cf1-fc6a-49b0-8758-c475c620f75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:17 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 Nov 05 22:21:17 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daddd326-2ffd-4db4-8163-1b3dfa526dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daddd326-2ffd-4db4-8163-1b3dfa526dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '300228a3-14f1-4bbd-8078-afa4b9edcd05', 'volume_name': 'volume-300228a3-14f1-4bbd-8078-afa4b9edcd05', 'volume_size': 1, 'snapshot_id': '073f5669-72d5-437e-903d-2903d96e6198'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f722236-8ef8-47f4-95c0-def22ab484cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f722236-8ef8-47f4-95c0-def22ab484cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc727d5-6957-4b43-af71-0ae202e01f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:17 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Volume 300228a3-14f1-4bbd-8078-afa4b9edcd05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-300228a3-14f1-4bbd-8078-afa4b9edcd05', 'volume_size': 1, 'snapshot_id': '073f5669-72d5-437e-903d-2903d96e6198'} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-073f5669-72d5-437e-903d-2903d96e6198-300228a3-14f1-4bbd-8078-afa4b9edcd05" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-073f5669-72d5-437e-903d-2903d96e6198-300228a3-14f1-4bbd-8078-afa4b9edcd05" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Creating volume 300228a3-14f1-4bbd-8078-afa4b9edcd05 from snapshot 073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-300228a3-14f1-4bbd-8078-afa4b9edcd05" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-300228a3-14f1-4bbd-8078-afa4b9edcd05" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] snapshot: 073f5669-72d5-437e-903d-2903d96e6198, volume: 300228a3-14f1-4bbd-8078-afa4b9edcd05, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d8eeb-6239-48a2-a588-4ae9748af290]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:18 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 Nov 05 22:21:18 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:18 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8" returned: 0 in 0.788s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:18 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8 Nov 05 22:21:18 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:18 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198" returned: 0 in 0.552s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afad416d-46c9-4845-ac75-b868f1d90d81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be489c-ee3e-452e-aee5-c6307cafc44d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "cinder-7eec7c2d-072d-44af-990e-3cd2f0f859fd-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:18 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 Nov 05 22:21:18 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:18 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-7eec7c2d-072d-44af-990e-3cd2f0f859fd-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25b27aa2-6536-4067-9d3d-b233ae8c25f8" returned: 0 in 0.580s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-quobyte-25b27aa2-6536-4067-9d3d-b233ae8c25f8" released by "delete_volume" :: held 1.529s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "cinder-quobyte-7eec7c2d-072d-44af-990e-3cd2f0f859fd" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-quobyte-7eec7c2d-072d-44af-990e-3cd2f0f859fd" acquired by "delete_volume" :: waited 0.045s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Created reservations ['75b88050-a8da-4612-be4c-38c7d1429fa7', '8671a80f-2d42-4617-b499-cd57ec88c95c', '05a4a2e7-7af0-477f-a7b3-c230c05ff182', 'ddd945eb-8197-47bf-b32a-b15f8caf40c9'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e44379-ff29-4b50-8ac5-2e15fc0214f5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:19 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd Nov 05 22:21:19 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:19 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:19 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:19 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81" returned: 0 in 0.657s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:19 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 Nov 05 22:21:19 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:19 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:19 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Deleted volume successfully. Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5d1f5e6c-dd8d-495f-859b-704f43c0fb74 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-25b27aa2-6536-4067-9d3d-b233ae8c25f8-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:19 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd" returned: 0 in 0.801s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Acquiring lock "cinder-fa86f77a-287e-404f-b465-bf896251d7c0-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:20 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd Nov 05 22:21:20 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-fa86f77a-287e-404f-b465-bf896251d7c0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Acquiring lock "cinder-quobyte-fa86f77a-287e-404f-b465-bf896251d7c0" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-quobyte-fa86f77a-287e-404f-b465-bf896251d7c0" acquired by "delete_volume" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38cf4c1-95c2-4cd3-b269-84f893ce1df0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:20 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7eec7c2d-072d-44af-990e-3cd2f0f859fd" returned: 0 in 0.386s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-quobyte-7eec7c2d-072d-44af-990e-3cd2f0f859fd" released by "delete_volume" :: held 1.265s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:20 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 Nov 05 22:21:20 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Created reservations ['1a76b9a9-93bb-40b1-ac05-f5721d2b94d6', 'cea6a4b8-9815-40cf-98a4-f5ddd4112112', 'cce5992e-1965-4a53-8a69-8123d9b74a4b', '618b07ea-4eea-49f0-a4da-e47639963df8'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:20 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:20 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:21 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0" returned: 0 in 0.872s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:21 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0 Nov 05 22:21:21 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "cinder-42bf1611-11bf-454a-baed-73e24218f295-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:21 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.732s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Deleted volume successfully. Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-42bf1611-11bf-454a-baed-73e24218f295-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:21 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-491eafce-ddc6-4a09-a4c0-1d41854183b3 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-7eec7c2d-072d-44af-990e-3cd2f0f859fd-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fa86f77a-287e-404f-b465-bf896251d7c0" returned: 0 in 0.657s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "cinder-quobyte-42bf1611-11bf-454a-baed-73e24218f295" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-quobyte-fa86f77a-287e-404f-b465-bf896251d7c0" released by "delete_volume" :: held 1.670s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-quobyte-42bf1611-11bf-454a-baed-73e24218f295" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84ba3f7-75e1-48ad-9950-5f1145e14e3c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Created reservations ['5d66610a-8ade-405a-be67-32b6e7109468', 'ff0aeddc-d151-4370-8c71-35c7aa02d0c0', 'bcd96c8c-97ce-49eb-aa11-c1172089cf41', '54fcf717-110b-4105-9879-2ee83eaf980f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:22 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 Nov 05 22:21:22 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:22 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:22 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:22 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.631s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:22 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Deleted volume successfully. Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2de1bb66-97f1-4ffc-a9b7-e27cdd173a08 tempest-VolumesListTestJSON-919478158 None] Lock "cinder-fa86f77a-287e-404f-b465-bf896251d7c0-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:22 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295" returned: 0 in 0.983s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:23 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295 Nov 05 22:21:23 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:23 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-42bf1611-11bf-454a-baed-73e24218f295" returned: 0 in 0.587s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-quobyte-42bf1611-11bf-454a-baed-73e24218f295" released by "delete_volume" :: held 1.713s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Created reservations ['d2271335-a81c-4b78-9136-0a68afb1cae9', 'b46d3875-c769-4613-b099-7259b8cd5cc6', '6ac9a1d3-b08b-40f7-93be-f1d3a1a2e38b', 'f865af48-d575-4bb4-af8b-cb43d4125450'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:24 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:24 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "cinder-aea721ff-72d0-410b-8413-84bc9bb63ea7-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-aea721ff-72d0-410b-8413-84bc9bb63ea7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:24 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.837s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:24 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Deleted volume successfully. Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eb48589b-7f83-45db-aa61-597aea06cab4 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-42bf1611-11bf-454a-baed-73e24218f295-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "cinder-quobyte-aea721ff-72d0-410b-8413-84bc9bb63ea7" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-quobyte-aea721ff-72d0-410b-8413-84bc9bb63ea7" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9221907-d6e6-44e8-938f-51d40cafdf88]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:25 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 Nov 05 22:21:25 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:26 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7" returned: 0 in 1.120s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:26 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7 Nov 05 22:21:26 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:26 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aea721ff-72d0-410b-8413-84bc9bb63ea7" returned: 0 in 0.919s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-quobyte-aea721ff-72d0-410b-8413-84bc9bb63ea7" released by "delete_volume" :: held 2.154s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Created reservations ['62f8f5de-fe6d-4eb2-b80b-af2a70d347e8', 'db1f719a-c9bf-42ed-a30e-6305552d239a', '22b18932-ebbb-44c6-8d34-10b349cc307a', 'ac20ef9a-b952-4566-943c-84f2f7027a44'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:27 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:27 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:28 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.998s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:28 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Deleted volume successfully. Nov 05 22:21:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9727781b-7310-4da3-93be-89d5ab74b241 tempest-AttachVolumeTestJSON-1488034404 None] Lock "cinder-aea721ff-72d0-410b-8413-84bc9bb63ea7-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:30 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05" returned: 0 in 10.959s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81, size 1024.00 MB, duration 10.96 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:21:30 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Converted 1024.00 MB image at 93.43 MB/s Nov 05 22:21:30 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 is being set with open permissions: ugo+rw Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:30 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 Nov 05 22:21:30 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:30 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-300228a3-14f1-4bbd-8078-afa4b9edcd05" released by "_copy_volume_from_snapshot" :: held 12.710s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-073f5669-72d5-437e-903d-2903d96e6198-300228a3-14f1-4bbd-8078-afa4b9edcd05" released by "_create_volume_from_snapshot" :: held 12.824s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.853s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc727d5-6957-4b43-af71-0ae202e01f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300228a3-14f1-4bbd-8078-afa4b9edcd05', 'volume_size': 1, 'snapshot_id': '073f5669-72d5-437e-903d-2903d96e6198'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d7e5f9-d06b-4a82-96e6-b479e0518dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:30 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Volume volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 (300228a3-14f1-4bbd-8078-afa4b9edcd05): created successfully Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d7e5f9-d06b-4a82-96e6-b479e0518dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Flow 'volume_create_manager' (df221928-09ff-4ef0-94e1-64871e446f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:30 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0aee07d9-eb39-4504-b66d-f74872ec6e5d tempest-VolumesDeleteCascade-207450447 None] Created volume successfully. Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-afad416d-46c9-4845-ac75-b868f1d90d81-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-afad416d-46c9-4845-ac75-b868f1d90d81-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Performing cascade delete. {{(pid=87085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-073f5669-72d5-437e-903d-2903d96e6198-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-073f5669-72d5-437e-903d-2903d96e6198-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-afad416d-46c9-4845-ac75-b868f1d90d81" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-afad416d-46c9-4845-ac75-b868f1d90d81" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-073f5669-72d5-437e-903d-2903d96e6198" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-073f5669-72d5-437e-903d-2903d96e6198" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Deleting offline snapshot 073f5669-72d5-437e-903d-2903d96e6198 of volume afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] snapshot_file for this snap is: volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c336e3-a583-4438-8f42-be02a7b92f63]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:31 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 Nov 05 22:21:31 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:32 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198" returned: 0 in 0.588s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afad416d-46c9-4845-ac75-b868f1d90d81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d2463-36fa-4e1f-9968-e4df73897fb9]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=117,cinder:INSERT=37,cinder:UPDATE=125,cinder:DELETE=13 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:INSERT=35,cinder:UPDATE=134,cinder:SELECT=140,cinder:DELETE=10 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Flow 'volume_create_manager' (a0604536-7599-4970-b0bb-180c9f9de62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:32 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 Nov 05 22:21:32 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175e6111-ad4c-4b25-82bd-f0128160a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175e6111-ad4c-4b25-82bd-f0128160a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-63734576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8650690-7976-445c-90b2-502da95913bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff23d45e744a40c28f2b3346d3485c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:32Z,use_quota=True,user_id='8bb5b3793fbb4e99a8b66efc4c6046d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5572bd12-7ebd-4c1e-b138-4f2b1243eff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5572bd12-7ebd-4c1e-b138-4f2b1243eff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675f6cd3-2413-4011-87c4-900fd667c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675f6cd3-2413-4011-87c4-900fd667c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8650690-7976-445c-90b2-502da95913bb', 'volume_name': 'volume-c8650690-7976-445c-90b2-502da95913bb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf5279-3f84-47fb-8292-249fb339bd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bf5279-3f84-47fb-8292-249fb339bd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be10be8-1e71-4a64-af3a-ceb89827dd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Volume c8650690-7976-445c-90b2-502da95913bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8650690-7976-445c-90b2-502da95913bb', 'volume_size': 1} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-63734576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8650690-7976-445c-90b2-502da95913bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff23d45e744a40c28f2b3346d3485c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:32Z,use_quota=True,user_id='8bb5b3793fbb4e99a8b66efc4c6046d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Creating volume c8650690-7976-445c-90b2-502da95913bb {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:32 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:32 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb 1073741824 Nov 05 22:21:32 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:32 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81" returned: 0 in 0.657s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:32 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 Nov 05 22:21:32 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:33 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb 1073741824" returned: 0 in 0.527s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:33 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb Nov 05 22:21:33 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:33 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198" returned: 0 in 0.388s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:33 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198 Nov 05 22:21:33 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:33 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb" returned: 0 in 0.259s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be10be8-1e71-4a64-af3a-ceb89827dd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8650690-7976-445c-90b2-502da95913bb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65b7bf5-2840-4f9f-93cd-d9a977f5fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:33 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Volume volume-c8650690-7976-445c-90b2-502da95913bb (c8650690-7976-445c-90b2-502da95913bb): created successfully Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65b7bf5-2840-4f9f-93cd-d9a977f5fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Flow 'volume_create_manager' (a0604536-7599-4970-b0bb-180c9f9de62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-68045c8c-929a-47b8-8863-5fcb2c7e0d9a tempest-VolumesNegativeTest-768000584 None] Created volume successfully. Nov 05 22:21:33 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81.073f5669-72d5-437e-903d-2903d96e6198" returned: 0 in 0.254s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-073f5669-72d5-437e-903d-2903d96e6198" released by "_delete_snapshot" :: held 2.015s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-afad416d-46c9-4845-ac75-b868f1d90d81" released by "delete_snapshot" :: held 2.043s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Created reservations ['f0c51f52-b19f-4c14-99a3-89fa69d2bba6', 'd5f833dd-8176-483f-bf69-8a34495173ea', '25069716-0119-4de7-b4b3-8b570c5d4efe', 'd67b9317-3ae2-4288-b339-df6fc6c60923'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Delete snapshot completed successfully. Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-073f5669-72d5-437e-903d-2903d96e6198-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Snapshots deleted, issuing volume delete {{(pid=87085) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-afad416d-46c9-4845-ac75-b868f1d90d81" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-afad416d-46c9-4845-ac75-b868f1d90d81" acquired by "delete_volume" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ec576-49b1-4463-8a5c-76735cc41f68]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:33 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 Nov 05 22:21:33 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:34 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81" returned: 0 in 0.418s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:34 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81 Nov 05 22:21:34 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:34 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-afad416d-46c9-4845-ac75-b868f1d90d81" returned: 0 in 0.279s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-afad416d-46c9-4845-ac75-b868f1d90d81" released by "delete_volume" :: held 0.772s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Created reservations ['54b510e7-bb12-459b-a81f-3a98c7e74b9f', '1c36849b-9136-421d-87a4-846b3f8d5392', '3fac6d90-e7ed-4daf-9516-71a93e82d9d5', 'fd2bc000-d315-4fa2-9f6a-754c199652b1'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:34 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:34 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-300228a3-14f1-4bbd-8078-afa4b9edcd05-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-300228a3-14f1-4bbd-8078-afa4b9edcd05-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:35 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "cinder-quobyte-300228a3-14f1-4bbd-8078-afa4b9edcd05" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Deleted volume successfully. Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-300228a3-14f1-4bbd-8078-afa4b9edcd05" acquired by "delete_volume" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c22188a-a4ef-4837-a713-6caf0b6de3a7 tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-afad416d-46c9-4845-ac75-b868f1d90d81-delete_volume" released by "delete_volume" :: held 3.725s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cff154-85fe-4102-bfc2-568102a31f1d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:35 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 Nov 05 22:21:35 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:35 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05" returned: 0 in 0.451s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:35 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05 Nov 05 22:21:35 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:35 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-300228a3-14f1-4bbd-8078-afa4b9edcd05" returned: 0 in 0.304s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-quobyte-300228a3-14f1-4bbd-8078-afa4b9edcd05" released by "delete_volume" :: held 0.822s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Created reservations ['79bf3518-f84b-40be-964f-15aedf9f8051', '06e527c8-8ede-4ccf-85cd-bc03d817a074', '8f11b23d-d13d-4100-a9ed-54502ee9653a', '06281dac-012a-408c-80c9-b05c2c539bbb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:36 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:36 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:36 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.403s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Deleted volume successfully. Nov 05 22:21:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-89f26315-f026-41b3-8d74-71e17c33e80a tempest-VolumesDeleteCascade-207450447 None] Lock "cinder-300228a3-14f1-4bbd-8078-afa4b9edcd05-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:40 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:40 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:40 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.388s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:21:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Flow 'volume_create_manager' (09112f80-08b5-4652-824c-80c2e3ea39a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d4c269-7cce-45e0-a1a4-4ee83e69478e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d4c269-7cce-45e0-a1a4-4ee83e69478e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1810417519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c974b646-e587-415d-bcc4-5c71941b8264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbdd292e9e94a51b94201ff81e69179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:47Z,use_quota=True,user_id='9e9a91a1aadb44a8835e39d4b0f4e0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2331606e-9f00-40bd-8554-f520fb9b17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2331606e-9f00-40bd-8554-f520fb9b17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df41a2cb-fc92-4f71-9ff7-09984786a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df41a2cb-fc92-4f71-9ff7-09984786a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c974b646-e587-415d-bcc4-5c71941b8264', 'volume_name': 'volume-c974b646-e587-415d-bcc4-5c71941b8264', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb15c2d6-b229-4a2e-b6a0-9ba475bc2dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb15c2d6-b229-4a2e-b6a0-9ba475bc2dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a09807-8752-4367-b63a-43f5c31e6d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:46 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Volume c974b646-e587-415d-bcc4-5c71941b8264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c974b646-e587-415d-bcc4-5c71941b8264', 'volume_size': 1} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1810417519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c974b646-e587-415d-bcc4-5c71941b8264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbdd292e9e94a51b94201ff81e69179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:47Z,use_quota=True,user_id='9e9a91a1aadb44a8835e39d4b0f4e0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Creating volume c974b646-e587-415d-bcc4-5c71941b8264 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:46 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:21:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:47 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 1073741824 Nov 05 22:21:47 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-065d707a-795e-4da3-8ae7-560b7e90cd2b tempest-ServerActionsTestOtherA-197608559 None] Terminate volume connection completed successfully. Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-065d707a-795e-4da3-8ae7-560b7e90cd2b tempest-ServerActionsTestOtherA-197608559 None] Deleting attachment 9d0d3b56-ed49-44ca-827b-a6c789826b10. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:21:47 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 1073741824" returned: 0 in 0.649s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "cinder-dd959ec9-2698-4bd3-8ff4-19c792458f99-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:47 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 Nov 05 22:21:47 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-dd959ec9-2698-4bd3-8ff4-19c792458f99-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "cinder-quobyte-dd959ec9-2698-4bd3-8ff4-19c792458f99" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-quobyte-dd959ec9-2698-4bd3-8ff4-19c792458f99" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0acdb9-d896-4ba4-aa32-2bddd8f94df6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:48 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 Nov 05 22:21:48 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:48 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264" returned: 0 in 0.547s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a09807-8752-4367-b63a-43f5c31e6d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c974b646-e587-415d-bcc4-5c71941b8264', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbaf956-49f3-43df-9fc2-d83bc20c47fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:48 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Volume volume-c974b646-e587-415d-bcc4-5c71941b8264 (c974b646-e587-415d-bcc4-5c71941b8264): created successfully Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbaf956-49f3-43df-9fc2-d83bc20c47fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Flow 'volume_create_manager' (09112f80-08b5-4652-824c-80c2e3ea39a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:48 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-71f4894c-a5cb-4fad-b043-421ad03f1b5d tempest-VolumesTransfersTest-646168557 None] Created volume successfully. Nov 05 22:21:48 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99" returned: 0 in 0.680s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:48 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99 Nov 05 22:21:48 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:48 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dd959ec9-2698-4bd3-8ff4-19c792458f99" returned: 0 in 0.375s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-quobyte-dd959ec9-2698-4bd3-8ff4-19c792458f99" released by "delete_volume" :: held 1.134s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "cinder-1f3ce072-e25f-494b-8cf2-3322c476d6b9-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-1f3ce072-e25f-494b-8cf2-3322c476d6b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.quota [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Created reservations ['e98bba49-1136-4bf9-a34a-c56da07ed1aa', 'd140f576-f4d2-467a-b086-dbdcbdc18681', '20b991d9-f1a4-4404-934e-6d764be0af0a', 'e57226b2-172c-488e-adc4-fc9847f42702'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "cinder-quobyte-1f3ce072-e25f-494b-8cf2-3322c476d6b9" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-quobyte-1f3ce072-e25f-494b-8cf2-3322c476d6b9" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[374037f9-cf41-4338-8ae3-4e156c3773ac]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:49 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:49 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:49 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 Nov 05 22:21:49 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:49 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9" returned: 0 in 0.589s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:49 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.623s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.manager [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Deleted volume successfully. Nov 05 22:21:49 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9 Nov 05 22:21:49 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-9af52bd9-6447-403d-b8e1-37faa0cd0f45 req-225cfde0-8ace-4c2f-b75b-924404d6e229 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-dd959ec9-2698-4bd3-8ff4-19c792458f99-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c49b15fe-e5f8-4bee-9788-62a659eb29b3 tempest-VolumesTransfersTest-1198489364 None] Transfer volume completed successfully. Nov 05 22:21:50 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1f3ce072-e25f-494b-8cf2-3322c476d6b9" returned: 0 in 0.519s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-quobyte-1f3ce072-e25f-494b-8cf2-3322c476d6b9" released by "delete_volume" :: held 1.167s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Created reservations ['b10f6ddc-1b44-4975-a0ee-7ff2b7ca93c7', 'a9fcac71-17ee-48ac-bf0f-f53910fb7aef', '447b1a54-ef27-4b20-8606-21bbac5d8879', '01c85d50-bf12-4f3a-b6bb-daca16efcb10'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:50 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:50 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:50 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.393s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:50 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Deleted volume successfully. Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Acquiring lock "cinder-c974b646-e587-415d-bcc4-5c71941b8264-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-93d936ec-7235-4ab6-8fc3-64501019e501 tempest-ServerActionsTestOtherA-197608559 None] Lock "cinder-1f3ce072-e25f-494b-8cf2-3322c476d6b9-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-c974b646-e587-415d-bcc4-5c71941b8264-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Acquiring lock "cinder-quobyte-c974b646-e587-415d-bcc4-5c71941b8264" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-quobyte-c974b646-e587-415d-bcc4-5c71941b8264" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dc7c10-33ea-479a-82d5-d70ec4e4a62f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:51 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 Nov 05 22:21:51 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:51 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264" returned: 0 in 0.729s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:51 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264 Nov 05 22:21:51 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:52 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c974b646-e587-415d-bcc4-5c71941b8264" returned: 0 in 0.518s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-quobyte-c974b646-e587-415d-bcc4-5c71941b8264" released by "delete_volume" :: held 1.309s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Created reservations ['c268a1d3-bead-4212-a36a-afc3840d1cb1', '6ace01db-d1df-40cf-bf53-b3dc79ff57dc', '998c2b62-8c4a-432b-9eeb-db88b9c78664', '00b5c628-d79c-481f-9588-c585f76a1885'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:52 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:52 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:52 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Deleted volume successfully. Nov 05 22:21:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b1ef7fb4-fa07-4202-9287-a96cb6216265 tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-c974b646-e587-415d-bcc4-5c71941b8264-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Flow 'volume_create_manager' (3e7550d3-e741-489c-bc5a-eec61a7f3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995b003b-e7a9-4a5f-ba39-08df7e2acd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995b003b-e7a9-4a5f-ba39-08df7e2acd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1156250906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248ec3ca-a3fc-46ad-a11b-a94272929531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbdd292e9e94a51b94201ff81e69179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:54Z,use_quota=True,user_id='9e9a91a1aadb44a8835e39d4b0f4e0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65c43d6-d81d-4c71-bdd5-4d31ec56099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65c43d6-d81d-4c71-bdd5-4d31ec56099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a576a78-c94d-41d2-8585-aede9f677e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a576a78-c94d-41d2-8585-aede9f677e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248ec3ca-a3fc-46ad-a11b-a94272929531', 'volume_name': 'volume-248ec3ca-a3fc-46ad-a11b-a94272929531', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea4025c-459c-4cc3-a9e7-5efbbbc6e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea4025c-459c-4cc3-a9e7-5efbbbc6e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d792f24-4c5f-4381-8d3b-8137f879271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Volume 248ec3ca-a3fc-46ad-a11b-a94272929531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248ec3ca-a3fc-46ad-a11b-a94272929531', 'volume_size': 1} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1156250906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248ec3ca-a3fc-46ad-a11b-a94272929531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbdd292e9e94a51b94201ff81e69179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:21:54Z,use_quota=True,user_id='9e9a91a1aadb44a8835e39d4b0f4e0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Creating volume 248ec3ca-a3fc-46ad-a11b-a94272929531 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:21:54 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:54 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 1073741824 Nov 05 22:21:54 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:54 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 1073741824" returned: 0 in 0.725s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:55 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 Nov 05 22:21:55 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:55 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531" returned: 0 in 0.481s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d792f24-4c5f-4381-8d3b-8137f879271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248ec3ca-a3fc-46ad-a11b-a94272929531', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103cf66c-bcdc-4abb-83a3-112d58f2a9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:21:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Volume volume-248ec3ca-a3fc-46ad-a11b-a94272929531 (248ec3ca-a3fc-46ad-a11b-a94272929531): created successfully Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103cf66c-bcdc-4abb-83a3-112d58f2a9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:21:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Flow 'volume_create_manager' (3e7550d3-e741-489c-bc5a-eec61a7f3a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:21:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-07a2d917-b952-439b-9419-5b0a5001cc49 tempest-VolumesTransfersTest-646168557 None] Created volume successfully. Nov 05 22:21:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Acquiring lock "cinder-248ec3ca-a3fc-46ad-a11b-a94272929531-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-248ec3ca-a3fc-46ad-a11b-a94272929531-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Acquiring lock "cinder-quobyte-248ec3ca-a3fc-46ad-a11b-a94272929531" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:21:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-quobyte-248ec3ca-a3fc-46ad-a11b-a94272929531" acquired by "delete_volume" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:21:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e77973-450c-4d29-8016-2f09f31fd900]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:21:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:56 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 Nov 05 22:21:56 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:57 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531" returned: 0 in 0.482s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:57 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531 Nov 05 22:21:57 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:57 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-248ec3ca-a3fc-46ad-a11b-a94272929531" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-quobyte-248ec3ca-a3fc-46ad-a11b-a94272929531" released by "delete_volume" :: held 0.876s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Created reservations ['ae180220-efac-4bf2-af89-56038f5321b6', 'bab985c8-e57e-4ced-9348-027377cf6b03', '13562485-23ad-4d6f-9499-5bff994094df', 'fc9d756b-d141-44b4-93cc-0e25764c0939'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:21:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:21:57 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:21:57 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:21:58 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Nov 05 22:21:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.460s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:21:58 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:21:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Deleted volume successfully. Nov 05 22:21:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ef59180e-bd09-4a50-869c-fbab62ff851c tempest-VolumesTransfersTest-1226078430 None] Lock "cinder-248ec3ca-a3fc-46ad-a11b-a94272929531-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Acquiring lock "cinder-c8650690-7976-445c-90b2-502da95913bb-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Lock "cinder-c8650690-7976-445c-90b2-502da95913bb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Acquiring lock "cinder-quobyte-c8650690-7976-445c-90b2-502da95913bb" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Lock "cinder-quobyte-c8650690-7976-445c-90b2-502da95913bb" acquired by "delete_volume" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5948d0-0ed4-4aa7-8f27-a0e329d4f115]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:01 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb Nov 05 22:22:01 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:01 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb" returned: 0 in 0.456s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:01 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb Nov 05 22:22:01 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:01 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c8650690-7976-445c-90b2-502da95913bb" returned: 0 in 0.338s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Lock "cinder-quobyte-c8650690-7976-445c-90b2-502da95913bb" released by "delete_volume" :: held 0.849s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:01 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Created reservations ['54989033-3a21-4e09-a282-392255c361ad', 'f6d0f9e9-d9ad-419d-889b-215da20e966b', '8bce0b8d-15b0-464b-b47d-2e30fca44f87', '97e7d8e5-ef14-428e-8b62-67e92b7eee3d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:02 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:02 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:02 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.437s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Deleted volume successfully. Nov 05 22:22:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-21441427-6418-46fe-aeea-9249866babbc tempest-VolumesNegativeTest-768000584 None] Lock "cinder-c8650690-7976-445c-90b2-502da95913bb-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Flow 'volume_create_manager' (4f3f49bd-2fee-491f-8648-d8a7d82a93c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db68d62f-989f-4bfd-8868-66b6512a5a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db68d62f-989f-4bfd-8868-66b6512a5a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1437071338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b36e07a-dbe0-4597-8603-33b027a5b289,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='806bcc93dd6c460381e303a6ffb47e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:10Z,use_quota=True,user_id='c9fe99864b7949718a3e0381b1e61c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959a70fc-4f3b-46b6-902c-4ba2e9b772bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959a70fc-4f3b-46b6-902c-4ba2e9b772bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba58fb7-ab77-4dd4-b224-8001089b7141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba58fb7-ab77-4dd4-b224-8001089b7141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b36e07a-dbe0-4597-8603-33b027a5b289', 'volume_name': 'volume-0b36e07a-dbe0-4597-8603-33b027a5b289', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9d7983-44c0-4cf9-b75c-e29e693f4bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9d7983-44c0-4cf9-b75c-e29e693f4bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53d184a-8a33-43e4-b356-38d0269be093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:09 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Volume 0b36e07a-dbe0-4597-8603-33b027a5b289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b36e07a-dbe0-4597-8603-33b027a5b289', 'volume_size': 1} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1437071338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b36e07a-dbe0-4597-8603-33b027a5b289,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='806bcc93dd6c460381e303a6ffb47e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:10Z,use_quota=True,user_id='c9fe99864b7949718a3e0381b1e61c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Creating volume 0b36e07a-dbe0-4597-8603-33b027a5b289 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:09 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:10 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 1073741824 Nov 05 22:22:10 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Flow 'volume_create_manager' (3ed91b72-3adb-4c3e-8412-7ca303f435b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a5170d-c47e-45af-a311-51ed094aed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a5170d-c47e-45af-a311-51ed094aed5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2049518413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a08c2b-c364-4f48-be76-d05dc430e4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311bae5bc4d044bab98bacbe133d69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:10Z,use_quota=True,user_id='82636602125d45159b7c237fa151f317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8573123a-069d-452f-ad1b-d1ea4a1e00fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8573123a-069d-452f-ad1b-d1ea4a1e00fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99db7cf-2d05-40f3-801b-b5c5e9f099a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99db7cf-2d05-40f3-801b-b5c5e9f099a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a08c2b-c364-4f48-be76-d05dc430e4df', 'volume_name': 'volume-11a08c2b-c364-4f48-be76-d05dc430e4df', 'volume_size': 2}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb5d717-1fb3-4cf1-a169-50f1a5be3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb5d717-1fb3-4cf1-a169-50f1a5be3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3eb292-a9cd-4127-88e6-bbf04f5fac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Volume 11a08c2b-c364-4f48-be76-d05dc430e4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a08c2b-c364-4f48-be76-d05dc430e4df', 'volume_size': 2} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:10 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 1073741824" returned: 0 in 0.617s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:10 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 Nov 05 22:22:10 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:10 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289" returned: 0 in 0.325s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2049518413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a08c2b-c364-4f48-be76-d05dc430e4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='311bae5bc4d044bab98bacbe133d69df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:10Z,use_quota=True,user_id='82636602125d45159b7c237fa151f317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Creating volume 11a08c2b-c364-4f48-be76-d05dc430e4df {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:10 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df 2147483648 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:11 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df 2147483648 Nov 05 22:22:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53d184a-8a33-43e4-b356-38d0269be093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b36e07a-dbe0-4597-8603-33b027a5b289', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:11 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1444ccf7-e100-4740-8a4e-02a6926f2cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Volume volume-0b36e07a-dbe0-4597-8603-33b027a5b289 (0b36e07a-dbe0-4597-8603-33b027a5b289): created successfully Nov 05 22:22:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1444ccf7-e100-4740-8a4e-02a6926f2cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Flow 'volume_create_manager' (4f3f49bd-2fee-491f-8648-d8a7d82a93c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f65c584b-e238-4e5c-a00c-398322a26d8b tempest-VolumesTestJSON-1308620544 None] Created volume successfully. Nov 05 22:22:11 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df 2147483648" returned: 0 in 0.622s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:11 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df Nov 05 22:22:11 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:12 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df" returned: 0 in 0.636s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3eb292-a9cd-4127-88e6-bbf04f5fac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a08c2b-c364-4f48-be76-d05dc430e4df', 'volume_size': 2}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be97f4ea-9890-4ccb-af8c-1393267467d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Volume volume-11a08c2b-c364-4f48-be76-d05dc430e4df (11a08c2b-c364-4f48-be76-d05dc430e4df): created successfully Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be97f4ea-9890-4ccb-af8c-1393267467d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Flow 'volume_create_manager' (3ed91b72-3adb-4c3e-8412-7ca303f435b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:12 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-de9a14ae-5923-420a-8207-2aa1202ac695 tempest-VolumesCloneNegativeTest-697351753 None] Created volume successfully. Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Flow 'volume_create_manager' (279095ba-4ca5-4d0d-ac50-baf9d12bd377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882c3775-2369-445a-b15d-655e61169e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882c3775-2369-445a-b15d-655e61169e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-403331876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0152101e-c425-4113-9e65-d3091f601b91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='806bcc93dd6c460381e303a6ffb47e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:13Z,use_quota=True,user_id='c9fe99864b7949718a3e0381b1e61c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace621a0-dd9d-47b4-8793-75b08986f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace621a0-dd9d-47b4-8793-75b08986f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9697b96-4398-4035-bd8c-3bec2a4f821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9697b96-4398-4035-bd8c-3bec2a4f821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0152101e-c425-4113-9e65-d3091f601b91', 'volume_name': 'volume-0152101e-c425-4113-9e65-d3091f601b91', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a327ef5-efd3-4a32-b9bc-ad0e95e813cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a327ef5-efd3-4a32-b9bc-ad0e95e813cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da434a82-a322-4071-9d8c-17798c8fa4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Volume 0152101e-c425-4113-9e65-d3091f601b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0152101e-c425-4113-9e65-d3091f601b91', 'volume_size': 1} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-403331876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0152101e-c425-4113-9e65-d3091f601b91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='806bcc93dd6c460381e303a6ffb47e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:13Z,use_quota=True,user_id='c9fe99864b7949718a3e0381b1e61c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Creating volume 0152101e-c425-4113-9e65-d3091f601b91 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:12 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:12 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 1073741824 Nov 05 22:22:12 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:13 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 1073741824" returned: 0 in 0.516s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:13 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 Nov 05 22:22:13 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Acquiring lock "cinder-11a08c2b-c364-4f48-be76-d05dc430e4df-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Lock "cinder-11a08c2b-c364-4f48-be76-d05dc430e4df-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Acquiring lock "cinder-quobyte-11a08c2b-c364-4f48-be76-d05dc430e4df" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Lock "cinder-quobyte-11a08c2b-c364-4f48-be76-d05dc430e4df" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e78071-4ea9-42c6-8a1b-8a82fdeb4447]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:13 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91" returned: 0 in 0.411s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da434a82-a322-4071-9d8c-17798c8fa4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0152101e-c425-4113-9e65-d3091f601b91', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c42d26c-ec80-4b76-9869-9389d5da7640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Volume volume-0152101e-c425-4113-9e65-d3091f601b91 (0152101e-c425-4113-9e65-d3091f601b91): created successfully Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c42d26c-ec80-4b76-9869-9389d5da7640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Flow 'volume_create_manager' (279095ba-4ca5-4d0d-ac50-baf9d12bd377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b8b4fe69-b6e4-4c35-8f29-77179970e4e3 tempest-VolumesTestJSON-1308620544 None] Created volume successfully. Nov 05 22:22:13 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df Nov 05 22:22:13 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:14 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df" returned: 0 in 0.475s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:14 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df Nov 05 22:22:14 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:14 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-11a08c2b-c364-4f48-be76-d05dc430e4df" returned: 0 in 0.397s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Lock "cinder-quobyte-11a08c2b-c364-4f48-be76-d05dc430e4df" released by "delete_volume" :: held 0.952s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Created reservations ['5d0b2c15-c018-4cc5-9807-2b15d574846f', '1f877ce0-6cbb-46ff-be10-0787d2fe1fc4', 'f69ac245-3441-40f2-a6c1-4cb503d8ee88', '6531cc17-92c6-42fc-bc02-03200aaa89fa'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:14 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:14 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:15 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.387s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Deleted volume successfully. Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a789d606-03f0-4a2e-8ca7-359e4cd7a211 tempest-VolumesCloneNegativeTest-697351753 None] Lock "cinder-11a08c2b-c364-4f48-be76-d05dc430e4df-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Flow 'volume_create_manager' (efb8ec8a-f924-466d-ae9e-19fd3afbf644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccc8e87-5915-4f7c-ac4e-9e5c37d57a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccc8e87-5915-4f7c-ac4e-9e5c37d57a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2141427717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5a5ecd-b232-43c5-b54c-47db790db6e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='806bcc93dd6c460381e303a6ffb47e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:16Z,use_quota=True,user_id='c9fe99864b7949718a3e0381b1e61c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef39b40-ac82-4899-bc20-fba6e249619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef39b40-ac82-4899-bc20-fba6e249619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51754bf8-1b2c-4b70-a567-cbfc5a8ed464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51754bf8-1b2c-4b70-a567-cbfc5a8ed464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5a5ecd-b232-43c5-b54c-47db790db6e6', 'volume_name': 'volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c78c2d-fc59-4ace-bcff-0706388d5def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c78c2d-fc59-4ace-bcff-0706388d5def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d24c6de-549e-43d9-be54-98ff8269a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:15 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Volume 8c5a5ecd-b232-43c5-b54c-47db790db6e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6', 'volume_size': 1} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2141427717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5a5ecd-b232-43c5-b54c-47db790db6e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='806bcc93dd6c460381e303a6ffb47e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:16Z,use_quota=True,user_id='c9fe99864b7949718a3e0381b1e61c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Creating volume 8c5a5ecd-b232-43c5-b54c-47db790db6e6 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:16 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:16 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 1073741824 Nov 05 22:22:16 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:16 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 1073741824" returned: 0 in 0.604s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:16 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 Nov 05 22:22:16 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:17 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6" returned: 0 in 0.386s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d24c6de-549e-43d9-be54-98ff8269a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a95b07-14bd-4196-8ada-c8f5cd3b5676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:17 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Volume volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 (8c5a5ecd-b232-43c5-b54c-47db790db6e6): created successfully Nov 05 22:22:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a95b07-14bd-4196-8ada-c8f5cd3b5676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Flow 'volume_create_manager' (efb8ec8a-f924-466d-ae9e-19fd3afbf644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:17 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1efbfeaf-c26e-4762-a7db-664da0d3fa52 tempest-VolumesTestJSON-1308620544 None] Created volume successfully. Nov 05 22:22:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Acquiring lock "cinder-8c5a5ecd-b232-43c5-b54c-47db790db6e6-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Lock "cinder-8c5a5ecd-b232-43c5-b54c-47db790db6e6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Acquiring lock "cinder-quobyte-8c5a5ecd-b232-43c5-b54c-47db790db6e6" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Lock "cinder-quobyte-8c5a5ecd-b232-43c5-b54c-47db790db6e6" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6061ac-e1cc-4ddd-a8f2-1381eb9a9314]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:19 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 Nov 05 22:22:19 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:20 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6" returned: 0 in 0.475s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:20 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6 Nov 05 22:22:20 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:20 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8c5a5ecd-b232-43c5-b54c-47db790db6e6" returned: 0 in 0.276s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Lock "cinder-quobyte-8c5a5ecd-b232-43c5-b54c-47db790db6e6" released by "delete_volume" :: held 0.827s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Created reservations ['435b2f3a-58df-48fd-859c-4d6658ee0fc9', '7d6825f4-720d-4e5d-955e-12d46ecdf8cf', 'cfe088ad-5bc3-433e-9f79-670d83c7c4bc', '6213f742-ae96-4775-8170-a46b5a6fe6ec'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:20 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:20 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Acquiring lock "cinder-0152101e-c425-4113-9e65-d3091f601b91-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Lock "cinder-0152101e-c425-4113-9e65-d3091f601b91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Acquiring lock "cinder-quobyte-0152101e-c425-4113-9e65-d3091f601b91" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Lock "cinder-quobyte-0152101e-c425-4113-9e65-d3091f601b91" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13a955b-d1e8-4238-bdf4-6f8aea335d83]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:21 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 Nov 05 22:22:21 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:21 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.384s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Deleted volume successfully. Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12a19bc3-8bf0-4260-91ca-7040eb1a612e tempest-VolumesTestJSON-1308620544 None] Lock "cinder-8c5a5ecd-b232-43c5-b54c-47db790db6e6-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:21 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:21 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91 Nov 05 22:22:21 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:21 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Flow 'volume_create_manager' (3ef09439-3490-4c27-8e61-d6b3255964fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e77d0aa-da37-449a-b48e-a21f3d49ef52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0152101e-c425-4113-9e65-d3091f601b91" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e77d0aa-da37-449a-b48e-a21f3d49ef52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1080583336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a635562-4008-4049-93f9-6cb2cfe592ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc1bf45b8a44f082d5e4f16d6bb337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:22Z,use_quota=True,user_id='706a664a8e5e4ec78cd3c3a3f2c40998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d085439f-c173-4927-a0df-8d3aa6c646a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d085439f-c173-4927-a0df-8d3aa6c646a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06ba445-d201-495f-919f-421cf325b7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Lock "cinder-quobyte-0152101e-c425-4113-9e65-d3091f601b91" released by "delete_volume" :: held 0.877s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Created reservations ['c7514924-1a42-4d84-92b9-a566de534c25', '33b24818-74f1-4166-a80c-78bbfe3fa80a', '28d8f6a4-6a1a-46f5-b6e3-e6db12cfa0a9', 'fac8c093-5248-4d8e-9662-af14da3aba68'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:22 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:22 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Acquiring lock "cinder-0b36e07a-dbe0-4597-8603-33b027a5b289-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Lock "cinder-0b36e07a-dbe0-4597-8603-33b027a5b289-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06ba445-d201-495f-919f-421cf325b7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a635562-4008-4049-93f9-6cb2cfe592ce', 'volume_name': 'volume-7a635562-4008-4049-93f9-6cb2cfe592ce', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0d857f-2693-4e1b-9514-e52c24612784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0d857f-2693-4e1b-9514-e52c24612784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65112e9-c6cb-46f6-957c-57b87eef6ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:22 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Volume 7a635562-4008-4049-93f9-6cb2cfe592ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a635562-4008-4049-93f9-6cb2cfe592ce', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Trying to clone 7a635562-4008-4049-93f9-6cb2cfe592ce from image 7f51a389-75a1-4170-8607-9bba700950bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Acquiring lock "cinder-quobyte-0b36e07a-dbe0-4597-8603-33b027a5b289" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Lock "cinder-quobyte-0b36e07a-dbe0-4597-8603-33b027a5b289" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d2f29-ef45-44a3-9d62-29d8ce0d2b13]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:22 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.390s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:22 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Deleted volume successfully. Nov 05 22:22:22 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 Nov 05 22:22:22 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bdfb1d6e-4f83-40a9-ac4b-1a60161f62ed tempest-VolumesTestJSON-1308620544 None] Lock "cinder-0152101e-c425-4113-9e65-d3091f601b91-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:22:22 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[172421ea-4738-4ba1-803d-cf88cef33ac5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:22 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289" returned: 0 in 0.581s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:22 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289 Nov 05 22:22:22 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:22 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD Nov 05 22:22:22 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:23 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b36e07a-dbe0-4597-8603-33b027a5b289" returned: 0 in 0.359s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Lock "cinder-quobyte-0b36e07a-dbe0-4597-8603-33b027a5b289" released by "delete_volume" :: held 1.004s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:23 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc is fetched for user 706a664a8e5e4ec78cd3c3a3f2c40998. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Created reservations ['323eea9a-edde-47e0-b51c-9f9e1a7de11f', '29e435a5-069b-4f29-8a82-e81e01cb15e1', '7cc53b9d-826a-46ed-a0ef-a20f3057fb95', 'dc06eb77-68cb-4c8a-87b5-77bf981da211'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fd5ad2-fc86-4827-be79-a456d3a0d86f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:23 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:23 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:23 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD Nov 05 22:22:23 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:23 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.251s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Deleted volume successfully. Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bb5662d5-d49d-4592-a8c6-0677b9e2620b tempest-VolumesTestJSON-1308620544 None] Lock "cinder-0b36e07a-dbe0-4597-8603-33b027a5b289-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:23 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1080583336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a635562-4008-4049-93f9-6cb2cfe592ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc1bf45b8a44f082d5e4f16d6bb337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:22Z,use_quota=True,user_id='706a664a8e5e4ec78cd3c3a3f2c40998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Creating volume 7a635562-4008-4049-93f9-6cb2cfe592ce {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:23 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:23 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 1073741824 Nov 05 22:22:23 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (5a7b4b9c-9449-41dc-8e56-b520d6a4345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b180bf-87e4-4fb7-8f66-5f83f0158777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b180bf-87e4-4fb7-8f66-5f83f0158777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-947693926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27320515-db1c-4536-ad0c-0f2559daafe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:24Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba902a6-8665-4f14-b4ef-e63fb05818b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba902a6-8665-4f14-b4ef-e63fb05818b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbde80d5-70a7-4ed6-8484-272af18c56c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbde80d5-70a7-4ed6-8484-272af18c56c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27320515-db1c-4536-ad0c-0f2559daafe8', 'volume_name': 'volume-27320515-db1c-4536-ad0c-0f2559daafe8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8dc154-7d15-4cb9-966d-0fd4c604501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8dc154-7d15-4cb9-966d-0fd4c604501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd05d71b-4f38-448b-96d1-ab964610c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:24 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Volume 27320515-db1c-4536-ad0c-0f2559daafe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27320515-db1c-4536-ad0c-0f2559daafe8', 'volume_size': 1} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 1073741824" returned: 0 in 0.531s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:24 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce Nov 05 22:22:24 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:24 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce" returned: 0 in 0.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-947693926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27320515-db1c-4536-ad0c-0f2559daafe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:24Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Creating volume 27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:24 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:24 devstack sudo[96859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 1073741824 Nov 05 22:22:24 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Attempting download of 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume 7a635562-4008-4049-93f9-6cb2cfe592ce. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fc2e58-cd73-45da-8910-45a3701663fe]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_0ekxckur {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:24 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_0ekxckur Nov 05 22:22:24 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:25 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_0ekxckur" returned: 0 in 0.378s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_0ekxckur {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:25 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 1073741824" returned: 0 in 0.503s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:25 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 Nov 05 22:22:25 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:25 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_0ekxckur Nov 05 22:22:25 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:25 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8" returned: 0 in 0.291s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:25 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_0ekxckur" returned: 1 in 0.388s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_0ekxckur' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2eac35-be1d-4912-919b-171c834f2e34]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd05d71b-4f38-448b-96d1-ab964610c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27320515-db1c-4536-ad0c-0f2559daafe8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fa4828-4376-41c0-b913-dcd097b38d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:25 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Volume volume-27320515-db1c-4536-ad0c-0f2559daafe8 (27320515-db1c-4536-ad0c-0f2559daafe8): created successfully Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fa4828-4376-41c0-b913-dcd097b38d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (5a7b4b9c-9449-41dc-8e56-b520d6a4345d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-71ecadc8-16f1-405a-866b-cd5b861e4ea9 tempest-VolumesSnapshotTestJSON-262749634 None] Created volume successfully. Nov 05 22:22:25 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD Nov 05 22:22:25 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:25 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] 7f51a389-75a1-4170-8607-9bba700950bc was qcow2, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:22:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:25 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce Nov 05 22:22:25 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Creating offline snapshot 464a12e4-1128-4403-bada-ddb5b6444f58 of volume 27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:22:26 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf856c95-7008-404e-9d2a-11b734900695]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:27 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 Nov 05 22:22:27 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:27 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8" returned: 0 in 0.511s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:27 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 1G Nov 05 22:22:27 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:28 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 1G" returned: 0 in 0.620s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27320515-db1c-4536-ad0c-0f2559daafe8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:28 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27320515-db1c-4536-ad0c-0f2559daafe8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 Nov 05 22:22:28 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:28 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce" returned: 0 in 2.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_aoxwkrvodevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:22:28 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Converted 112.00 MB image at 47.15 MB/s Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:28 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 1G Nov 05 22:22:28 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:28 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27320515-db1c-4536-ad0c-0f2559daafe8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58" returned: 0 in 0.394s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:28 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 is being set with open permissions: ugo+rw Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:28 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 Nov 05 22:22:28 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:28 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 1G" returned: 0 in 0.465s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Downloaded image 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume 7a635562-4008-4049-93f9-6cb2cfe592ce successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc for user 706a664a8e5e4ec78cd3c3a3f2c40998 is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Marking volume 7a635562-4008-4049-93f9-6cb2cfe592ce as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Copying metadata from image 7f51a389-75a1-4170-8607-9bba700950bc to 7a635562-4008-4049-93f9-6cb2cfe592ce. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Creating volume glance metadata for volume 7a635562-4008-4049-93f9-6cb2cfe592ce backed by image 7f51a389-75a1-4170-8607-9bba700950bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:22:28 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58" returned: 0 in 0.318s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65112e9-c6cb-46f6-957c-57b87eef6ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a635562-4008-4049-93f9-6cb2cfe592ce', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1613ff14-3678-451f-844a-813c84502c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:28 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Volume volume-7a635562-4008-4049-93f9-6cb2cfe592ce (7a635562-4008-4049-93f9-6cb2cfe592ce): created successfully Nov 05 22:22:28 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.info Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1613ff14-3678-451f-844a-813c84502c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:28 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Flow 'volume_create_manager' (3ef09439-3490-4c27-8e61-d6b3255964fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8940c348-92ca-44f3-88ea-261e9ead9a0e tempest-VolumesExtendTest-956990523 None] Created volume successfully. Nov 05 22:22:29 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.info" returned: 0 in 0.308s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:29 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.info is being set with open permissions: ugo+rw Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:29 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.info Nov 05 22:22:29 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:29 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.info" returned: 0 in 0.331s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb5f3d-69aa-4500-9629-c6b261012abf]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-998ff3c9-bc51-4734-8665-9846fed5d453 tempest-VolumesSnapshotTestJSON-262749634 None] Create snapshot completed successfully Nov 05 22:22:29 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce Nov 05 22:22:29 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:29 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce" returned: 0 in 0.454s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 2G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce 2G" returned: 0 in 0.172s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.660s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-464a12e4-1128-4403-bada-ddb5b6444f58-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-464a12e4-1128-4403-bada-ddb5b6444f58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:30 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-71bf34d2-b862-4e94-a711-3e55ca9bf123 tempest-VolumesExtendTest-956990523 None] Extend volume completed successfully. Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-27320515-db1c-4536-ad0c-0f2559daafe8" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-27320515-db1c-4536-ad0c-0f2559daafe8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-464a12e4-1128-4403-bada-ddb5b6444f58" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-464a12e4-1128-4403-bada-ddb5b6444f58" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Deleting offline snapshot 464a12e4-1128-4403-bada-ddb5b6444f58 of volume 27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] snapshot_file for this snap is: volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a827a2-004e-4c1f-847f-e34398ff7149]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:30 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 Nov 05 22:22:30 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:30 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58" returned: 0 in 0.480s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27320515-db1c-4536-ad0c-0f2559daafe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[db08f20d-4fa0-43c8-ab29-9ed1482a455a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:31 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 Nov 05 22:22:31 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Acquiring lock "cinder-7a635562-4008-4049-93f9-6cb2cfe592ce-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Lock "cinder-7a635562-4008-4049-93f9-6cb2cfe592ce-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Acquiring lock "cinder-quobyte-7a635562-4008-4049-93f9-6cb2cfe592ce" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-7a635562-4008-4049-93f9-6cb2cfe592ce" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[312fd501-f489-4f07-8776-bbdd1d1a167f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:31 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8" returned: 0 in 0.565s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:31 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 Nov 05 22:22:31 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:31 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce Nov 05 22:22:31 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Flow 'volume_create_manager' (0b0a17fe-d2a6-41b0-889c-51b30ab10971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2fc436-da29-434d-b72d-7a13c041ec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2fc436-da29-434d-b72d-7a13c041ec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-943082953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0eb6f3-e621-4834-91a8-c68a00cab6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5119806ecb042268bf4053a59d63534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:32Z,use_quota=True,user_id='af3d393d7ca2437c8b18514217e8fb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8ef29e-325f-4c02-ba71-2747c1f080ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8ef29e-325f-4c02-ba71-2747c1f080ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca991cd-da92-4ff9-9fc0-ed5c5dd1c7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca991cd-da92-4ff9-9fc0-ed5c5dd1c7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0eb6f3-e621-4834-91a8-c68a00cab6e1', 'volume_name': 'volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9ee3d0-7f25-4536-9115-3ba948deb916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9ee3d0-7f25-4536-9115-3ba948deb916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396930e-1424-4642-82f3-408a6d7d6a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Volume 5e0eb6f3-e621-4834-91a8-c68a00cab6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1', 'volume_size': 1} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-943082953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0eb6f3-e621-4834-91a8-c68a00cab6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5119806ecb042268bf4053a59d63534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:32Z,use_quota=True,user_id='af3d393d7ca2437c8b18514217e8fb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Creating volume 5e0eb6f3-e621-4834-91a8-c68a00cab6e1 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:31 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:31 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 1073741824 Nov 05 22:22:31 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:31 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58" returned: 0 in 0.428s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:31 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58 Nov 05 22:22:31 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:31 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce" returned: 0 in 0.512s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:31 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce Nov 05 22:22:31 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:32 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8.464a12e4-1128-4403-bada-ddb5b6444f58" returned: 0 in 0.310s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-464a12e4-1128-4403-bada-ddb5b6444f58" released by "_delete_snapshot" :: held 1.961s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-27320515-db1c-4536-ad0c-0f2559daafe8" released by "delete_snapshot" :: held 1.991s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:32 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a635562-4008-4049-93f9-6cb2cfe592ce" returned: 0 in 0.332s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-7a635562-4008-4049-93f9-6cb2cfe592ce" released by "delete_volume" :: held 0.910s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:32 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 1073741824" returned: 0 in 0.538s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['3f49edfc-2f8c-4d7e-8e59-5d3311aaa240', 'd2553f3f-96c2-473a-b37b-e48df7b399b1', 'c33f87af-6751-481b-935d-3eb6893a1f6d', 'd75605be-125b-4f4b-b959-d11bac22b9a2'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Created reservations ['9c814a6b-be05-46fd-9a64-f90dbe360a0b', 'af054e3f-d80e-42e2-8345-cd517ad3138d', '95e5e393-fdb0-4030-a3af-f8747c063593', 'cdb96e36-69b8-4022-9b5c-d3502f8a472a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=112,cinder:UPDATE=126,cinder:DELETE=13,cinder:INSERT=38 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:22:32 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 Nov 05 22:22:32 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Delete snapshot completed successfully. Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-482eefa1-54d2-4f73-b6d6-6a0e362a0f42 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-464a12e4-1128-4403-bada-ddb5b6444f58-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:32 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:32 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:32 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1" returned: 0 in 0.365s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=106,cinder:INSERT=42,cinder:UPDATE=150,cinder:DELETE=8 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396930e-1424-4642-82f3-408a6d7d6a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45327b5d-2088-43ff-873b-c33be073a0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Volume volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 (5e0eb6f3-e621-4834-91a8-c68a00cab6e1): created successfully Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45327b5d-2088-43ff-873b-c33be073a0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Flow 'volume_create_manager' (0b0a17fe-d2a6-41b0-889c-51b30ab10971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:32 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8c753871-8bbd-4f96-a7bb-1e5326e797f1 tempest-AttachVolumeNegativeTest-1709425686 None] Created volume successfully. Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.277s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Deleted volume successfully. Nov 05 22:22:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-47828fd9-880a-4ac8-b591-c5671584deb8 tempest-VolumesExtendTest-956990523 None] Lock "cinder-7a635562-4008-4049-93f9-6cb2cfe592ce-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (8232c213-5076-4141-a024-b48945180aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fa32ea-c270-43d9-9665-886c0b4f9372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fa32ea-c270-43d9-9665-886c0b4f9372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-456664269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cb850f-9e3b-4532-85ec-2c85612abd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:34Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5459eb-a9dc-42c5-a2d2-d420b54a1033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5459eb-a9dc-42c5-a2d2-d420b54a1033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b7fbb0-ae12-410d-aa3f-f7d15a4ea1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b7fbb0-ae12-410d-aa3f-f7d15a4ea1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cb850f-9e3b-4532-85ec-2c85612abd27', 'volume_name': 'volume-25cb850f-9e3b-4532-85ec-2c85612abd27', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6c69df-fcd8-4dee-b8e3-b078e01d75aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6c69df-fcd8-4dee-b8e3-b078e01d75aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729f1545-df2d-491b-b269-1e31dca050b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Volume 25cb850f-9e3b-4532-85ec-2c85612abd27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cb850f-9e3b-4532-85ec-2c85612abd27', 'volume_size': 1} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-456664269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cb850f-9e3b-4532-85ec-2c85612abd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:34Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Creating volume 25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:34 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:34 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 1073741824 Nov 05 22:22:34 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b95a89b-1d0f-4eb4-9aa8-7eee2827b758 tempest-BackendsCapabilitiesAdminTestsJSON-814838632 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.420322418213, 'free_capacity_gb': 1773.420322418213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87085) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-46fdf15b-58fd-4463-a34f-a5ac5927af05 tempest-BackendsCapabilitiesAdminTestsJSON-814838632 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.420322418213, 'free_capacity_gb': 1773.420322418213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87085) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Flow 'volume_create_manager' (c9fa8e78-0a3f-46e8-af49-0552f6d224e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3724e734-e9e6-4e22-99d6-dbcb772b1fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3724e734-e9e6-4e22-99d6-dbcb772b1fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-399251528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198287a7-31fb-4549-a4ae-c1158c63b365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc1bf45b8a44f082d5e4f16d6bb337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:34Z,use_quota=True,user_id='706a664a8e5e4ec78cd3c3a3f2c40998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9534f85-9e29-4b40-854c-839931a636fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9534f85-9e29-4b40-854c-839931a636fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506c2a46-1860-4632-b351-c67f4186b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506c2a46-1860-4632-b351-c67f4186b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198287a7-31fb-4549-a4ae-c1158c63b365', 'volume_name': 'volume-198287a7-31fb-4549-a4ae-c1158c63b365', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dca6c5a-d59c-462e-9fc9-7392c74aaeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dca6c5a-d59c-462e-9fc9-7392c74aaeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182bfcb0-8ecd-4f3c-8f2f-cae135597c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:34 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Volume 198287a7-31fb-4549-a4ae-c1158c63b365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198287a7-31fb-4549-a4ae-c1158c63b365', 'volume_size': 1} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:34 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 1073741824" returned: 0 in 0.637s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:34 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 Nov 05 22:22:34 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:35 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-399251528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198287a7-31fb-4549-a4ae-c1158c63b365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc1bf45b8a44f082d5e4f16d6bb337',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:34Z,use_quota=True,user_id='706a664a8e5e4ec78cd3c3a3f2c40998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Creating volume 198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:35 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:35 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 1073741824 Nov 05 22:22:35 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729f1545-df2d-491b-b269-1e31dca050b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cb850f-9e3b-4532-85ec-2c85612abd27', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dfaee6-b6b7-48c0-9784-2e1424434699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-cb0f372f-7aa4-44c2-841b-817bb859c3c3 req-e0111277-94c6-451b-ade6-35fed92b0eb6 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Volume volume-25cb850f-9e3b-4532-85ec-2c85612abd27 (25cb850f-9e3b-4532-85ec-2c85612abd27): created successfully Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86dfaee6-b6b7-48c0-9784-2e1424434699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (8232c213-5076-4141-a024-b48945180aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f603a4aa-088c-4fdb-938b-b36e20eff184 tempest-VolumesSnapshotTestJSON-262749634 None] Created volume successfully. Nov 05 22:22:35 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 1073741824" returned: 0 in 0.489s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:35 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 Nov 05 22:22:35 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:35 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365" returned: 0 in 0.256s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-cb0f372f-7aa4-44c2-841b-817bb859c3c3 req-e0111277-94c6-451b-ade6-35fed92b0eb6 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.728s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182bfcb0-8ecd-4f3c-8f2f-cae135597c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198287a7-31fb-4549-a4ae-c1158c63b365', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936075f4-d896-4aa0-b1c0-5bbd37f45696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-cb0f372f-7aa4-44c2-841b-817bb859c3c3 req-e0111277-94c6-451b-ade6-35fed92b0eb6 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Volume volume-198287a7-31fb-4549-a4ae-c1158c63b365 (198287a7-31fb-4549-a4ae-c1158c63b365): created successfully Nov 05 22:22:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936075f4-d896-4aa0-b1c0-5bbd37f45696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Flow 'volume_create_manager' (c9fa8e78-0a3f-46e8-af49-0552f6d224e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-34552b12-e9df-4ba9-85b1-7a20966244ae tempest-VolumesExtendTest-956990523 None] Created volume successfully. Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-cb0f372f-7aa4-44c2-841b-817bb859c3c3 req-e0111277-94c6-451b-ade6-35fed92b0eb6 tempest-AttachVolumeNegativeTest-1709425686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ef1c8a8-e36d-4e0a-81cb-85c2ede20018', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:22:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-cb0f372f-7aa4-44c2-841b-817bb859c3c3 req-e0111277-94c6-451b-ade6-35fed92b0eb6 tempest-AttachVolumeNegativeTest-1709425686 None] attachment_update completed successfully. Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Creating offline snapshot 223b5e38-1404-415a-871d-df5262286841 of volume 25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9593aab0-7508-4301-b9a5-c424af9e352f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:37 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 Nov 05 22:22:37 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:37 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27" returned: 0 in 0.595s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:37 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 1G Nov 05 22:22:37 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:37 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 1G" returned: 0 in 0.463s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cb850f-9e3b-4532-85ec-2c85612abd27 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:37 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cb850f-9e3b-4532-85ec-2c85612abd27 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 Nov 05 22:22:37 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:38 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cb850f-9e3b-4532-85ec-2c85612abd27 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841" returned: 0 in 0.305s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:38 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 is being set with open permissions: ugo+rw Nov 05 22:22:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:38 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 Nov 05 22:22:38 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:38 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841" returned: 0 in 0.256s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:38 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.info Nov 05 22:22:38 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:38 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.info" returned: 0 in 0.300s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:38 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.info is being set with open permissions: ugo+rw Nov 05 22:22:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:38 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.info Nov 05 22:22:38 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:39 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.info" returned: 0 in 0.289s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.069s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Creating offline snapshot 4946530d-0323-4ba8-80e7-1e2fad44257a of volume 198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:22:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2987118d-25a2-4ea9-ad99-12403cb13655 tempest-VolumesSnapshotTestJSON-262749634 None] Create snapshot completed successfully Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cff116-7dff-4ce8-84b4-d7f365547847]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:39 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 Nov 05 22:22:39 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:39 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365" returned: 0 in 0.429s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:39 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a 1G Nov 05 22:22:39 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:40 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a 1G" returned: 0 in 0.503s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198287a7-31fb-4549-a4ae-c1158c63b365 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:40 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198287a7-31fb-4549-a4ae-c1158c63b365 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a Nov 05 22:22:40 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:40 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:40 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:40 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198287a7-31fb-4549-a4ae-c1158c63b365 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:40 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a is being set with open permissions: ugo+rw Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:40 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a Nov 05 22:22:40 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:40 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.351s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (2d2b9685-b270-4414-8fc1-923596a7e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160c76c7-bc91-4117-ba58-ae23d7b9b02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160c76c7-bc91-4117-ba58-ae23d7b9b02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-29258758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638f1691-2cbd-4d89-b80d-97dfca80d37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=223b5e38-1404-415a-871d-df5262286841,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:41Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57800049-914b-43f0-897d-9ab0cefb7027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57800049-914b-43f0-897d-9ab0cefb7027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccdfce4-88fc-41db-b019-e831706f6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccdfce4-88fc-41db-b019-e831706f6a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '638f1691-2cbd-4d89-b80d-97dfca80d37c', 'volume_name': 'volume-638f1691-2cbd-4d89-b80d-97dfca80d37c', 'volume_size': 2, 'snapshot_id': '223b5e38-1404-415a-871d-df5262286841'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25283156-f1da-4b8f-8f80-397626fd6e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25283156-f1da-4b8f-8f80-397626fd6e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba321265-73f4-4876-95e3-1ecdbde593bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:40 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Volume 638f1691-2cbd-4d89-b80d-97dfca80d37c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-638f1691-2cbd-4d89-b80d-97dfca80d37c', 'volume_size': 2, 'snapshot_id': '223b5e38-1404-415a-871d-df5262286841'} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:40 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a" returned: 0 in 0.334s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:40 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.info Nov 05 22:22:40 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:41 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.info" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:41 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.info is being set with open permissions: ugo+rw Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:41 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.info Nov 05 22:22:41 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5ccb83d5-a696-4678-ba70-d2b82efec668 tempest-GroupsV314Test-2090977082 None] Group tempest-GroupsV314Test-Group-656128979: creating Nov 05 22:22:41 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.info" returned: 0 in 0.278s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.725s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-223b5e38-1404-415a-871d-df5262286841-638f1691-2cbd-4d89-b80d-97dfca80d37c" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5ccb83d5-a696-4678-ba70-d2b82efec668 tempest-GroupsV314Test-2090977082 None] Group tempest-GroupsV314Test-Group-656128979: created successfully Nov 05 22:22:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5ccb83d5-a696-4678-ba70-d2b82efec668 tempest-GroupsV314Test-2090977082 None] Create group completed successfully. Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-223b5e38-1404-415a-871d-df5262286841-638f1691-2cbd-4d89-b80d-97dfca80d37c" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Creating volume 638f1691-2cbd-4d89-b80d-97dfca80d37c from snapshot 223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-638f1691-2cbd-4d89-b80d-97dfca80d37c" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3fa3f24a-d9d7-44ce-93fd-929b65825d7a tempest-VolumesExtendTest-956990523 None] Create snapshot completed successfully Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-638f1691-2cbd-4d89-b80d-97dfca80d37c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] snapshot: 223b5e38-1404-415a-871d-df5262286841, volume: 638f1691-2cbd-4d89-b80d-97dfca80d37c, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddbaf83-8414-40bb-b78c-04a0d332afc4]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:41 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 Nov 05 22:22:41 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:42 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841" returned: 0 in 0.404s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25cb850f-9e3b-4532-85ec-2c85612abd27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[873bfe3b-15f1-405d-bbad-ed159aa7c3af]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:42 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 Nov 05 22:22:42 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:42 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27" returned: 0 in 0.422s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:22:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:42 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c Nov 05 22:22:42 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Flow 'volume_create_manager' (3106462d-4f47-4a88-a89c-f6eea5ba03d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0a05d7-b1f1-43ee-98bc-31929f97ced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0a05d7-b1f1-43ee-98bc-31929f97ced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566706740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=771a7b37-79c5-4512-a3ec-e407903f7630,host='devstack@QuobyteHD#QuobyteHD',id=f2da8917-2de2-4e7a-bc6d-1268e500793b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cada1d29b3f47ee92a60150f2e6a95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:43Z,use_quota=True,user_id='3c828dc22dac46618e2e3b6d450dba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb4b0038-86e4-44b1-9e8c-2dcd7eba685e),volume_type_id=eb4b0038-86e4-44b1-9e8c-2dcd7eba685e)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfa5602-e679-49d6-90dd-4d30d6d0e737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfa5602-e679-49d6-90dd-4d30d6d0e737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4706c3e5-8929-4aec-8a44-072a7368f43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4706c3e5-8929-4aec-8a44-072a7368f43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2da8917-2de2-4e7a-bc6d-1268e500793b', 'volume_name': 'volume-f2da8917-2de2-4e7a-bc6d-1268e500793b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5977cb1c-3dbc-42e2-a240-f5e31bad0f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5977cb1c-3dbc-42e2-a240-f5e31bad0f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4d5013-3a1b-4b31-b623-304abe310025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:43 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Volume f2da8917-2de2-4e7a-bc6d-1268e500793b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2da8917-2de2-4e7a-bc6d-1268e500793b', 'volume_size': 1} Nov 05 22:22:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:52 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c" returned: 0 in 9.681s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27, size 1024.00 MB, duration 9.68 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:22:52 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Converted 1024.00 MB image at 105.75 MB/s Nov 05 22:22:52 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c is being set with open permissions: ugo+rw Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:52 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c Nov 05 22:22:52 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:52 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c" returned: 0 in 0.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-638f1691-2cbd-4d89-b80d-97dfca80d37c" released by "_copy_volume_from_snapshot" :: held 10.859s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-223b5e38-1404-415a-871d-df5262286841-638f1691-2cbd-4d89-b80d-97dfca80d37c" released by "_create_volume_from_snapshot" :: held 10.945s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.977s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 10.113s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[22572135-b237-4897-bfa9-ac5dd5ad35d1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba321265-73f4-4876-95e3-1ecdbde593bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-638f1691-2cbd-4d89-b80d-97dfca80d37c', 'volume_size': 2, 'snapshot_id': '223b5e38-1404-415a-871d-df5262286841'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c9d560-1e88-4543-abdd-657794d94d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:52 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Volume volume-638f1691-2cbd-4d89-b80d-97dfca80d37c (638f1691-2cbd-4d89-b80d-97dfca80d37c): created successfully Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c9d560-1e88-4543-abdd-657794d94d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (2d2b9685-b270-4414-8fc1-923596a7e56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7900f5be-9383-4abc-af7f-bf0523d86bc1 tempest-VolumesSnapshotTestJSON-262749634 None] Created volume successfully. Nov 05 22:22:52 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 Nov 05 22:22:52 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:52 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365" returned: 0 in 0.388s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a 2G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a 2G" returned: 0 in 0.212s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.637s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.508s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=771a7b37-79c5-4512-a3ec-e407903f7630,created_at=2026-11-05T21:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566706740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=771a7b37-79c5-4512-a3ec-e407903f7630,host='devstack@QuobyteHD#QuobyteHD',id=f2da8917-2de2-4e7a-bc6d-1268e500793b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cada1d29b3f47ee92a60150f2e6a95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:22:43Z,use_quota=True,user_id='3c828dc22dac46618e2e3b6d450dba88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb4b0038-86e4-44b1-9e8c-2dcd7eba685e),volume_type_id=eb4b0038-86e4-44b1-9e8c-2dcd7eba685e)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Creating volume f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:22:53 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-638f1691-2cbd-4d89-b80d-97dfca80d37c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:53 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b 1073741824 Nov 05 22:22:53 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-638f1691-2cbd-4d89-b80d-97dfca80d37c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f44c6203-e599-45a4-a95a-b3a8daac8ab8 tempest-VolumesExtendTest-956990523 None] Extend volume completed successfully. Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-638f1691-2cbd-4d89-b80d-97dfca80d37c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-638f1691-2cbd-4d89-b80d-97dfca80d37c" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[18584c1c-8737-4527-bc9f-88769f81fed9]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:53 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c Nov 05 22:22:53 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:53 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b 1073741824" returned: 0 in 0.681s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:53 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c" returned: 0 in 0.486s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:53 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c Nov 05 22:22:53 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:53 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b Nov 05 22:22:53 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Acquiring lock "cinder-4946530d-0323-4ba8-80e7-1e2fad44257a-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Lock "cinder-4946530d-0323-4ba8-80e7-1e2fad44257a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Acquiring lock "cinder-quobyte-198287a7-31fb-4549-a4ae-c1158c63b365" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-198287a7-31fb-4549-a4ae-c1158c63b365" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Acquiring lock "cinder-quobyte-4946530d-0323-4ba8-80e7-1e2fad44257a" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-4946530d-0323-4ba8-80e7-1e2fad44257a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Deleting offline snapshot 4946530d-0323-4ba8-80e7-1e2fad44257a of volume 198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] snapshot_file for this snap is: volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:22:54 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29237aa-11a0-4e03-aecd-3706df1ee6c8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-638f1691-2cbd-4d89-b80d-97dfca80d37c" returned: 0 in 0.413s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:54 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b" returned: 0 in 0.415s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-638f1691-2cbd-4d89-b80d-97dfca80d37c" released by "delete_volume" :: held 0.990s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4d5013-3a1b-4b31-b623-304abe310025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2da8917-2de2-4e7a-bc6d-1268e500793b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16328ab1-1f31-4669-87c5-18bc315f1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:22:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Volume volume-f2da8917-2de2-4e7a-bc6d-1268e500793b (f2da8917-2de2-4e7a-bc6d-1268e500793b): created successfully Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16328ab1-1f31-4669-87c5-18bc315f1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Flow 'volume_create_manager' (3106462d-4f47-4a88-a89c-f6eea5ba03d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:22:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-82638f05-83da-4deb-9d91-27f5f1c77d3d tempest-GroupsV314Test-2090977082 None] Created volume successfully. Nov 05 22:22:54 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a Nov 05 22:22:54 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['ba6e8a3a-1f9e-44af-9727-7a7418957ea9', '12a4bbd5-197d-4ede-9e23-dc72dd1e9879', '270eef24-cce9-4f74-94fe-729e16c87298', '34f81b24-dbe2-48fa-b1a9-38e015229525'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:54 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:54 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:54 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a" returned: 0 in 0.457s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198287a7-31fb-4549-a4ae-c1158c63b365(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e6521-6089-4e81-9b40-5d3a803d88c0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:54 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.373s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:54 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:54 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 Nov 05 22:22:54 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Deleted volume successfully. Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eed55cab-7813-45b0-8bf6-b32dfb777076 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-638f1691-2cbd-4d89-b80d-97dfca80d37c-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:55 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365" returned: 0 in 0.495s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:55 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a Nov 05 22:22:55 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-223b5e38-1404-415a-871d-df5262286841-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-223b5e38-1404-415a-871d-df5262286841-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-25cb850f-9e3b-4532-85ec-2c85612abd27" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:55 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-25cb850f-9e3b-4532-85ec-2c85612abd27" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-223b5e38-1404-415a-871d-df5262286841" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a" returned: 0 in 0.558s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-223b5e38-1404-415a-871d-df5262286841" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:55 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a Nov 05 22:22:55 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Deleting offline snapshot 223b5e38-1404-415a-871d-df5262286841 of volume 25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] snapshot_file for this snap is: volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a7e552-92fd-40a7-a811-5ba44ae71b2a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:56 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 Nov 05 22:22:56 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:56 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365.4946530d-0323-4ba8-80e7-1e2fad44257a" returned: 0 in 0.443s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-4946530d-0323-4ba8-80e7-1e2fad44257a" released by "_delete_snapshot" :: held 2.143s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-198287a7-31fb-4549-a4ae-c1158c63b365" released by "delete_snapshot" :: held 2.194s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Created reservations ['501d2464-be44-4d68-ae97-c092d8327c27', 'dc3d74fb-4953-4756-99a6-6ec3664d2c97', 'd25a24ee-03c2-4b28-8eb5-221e1b2c5554', 'fd2de3ed-cbec-45f9-8a34-fa76bbd0a067'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:56 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841" returned: 0 in 0.604s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25cb850f-9e3b-4532-85ec-2c85612abd27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc598fe-dae7-4b10-b416-a9e03893de41]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:56 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Delete snapshot completed successfully. Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4c9aec49-cdbb-4b4a-a119-d81ccb3694de tempest-VolumesExtendTest-956990523 None] Lock "cinder-4946530d-0323-4ba8-80e7-1e2fad44257a-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:56 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 Nov 05 22:22:56 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:56 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Cloning volume f2da8917-2de2-4e7a-bc6d-1268e500793b to volume cc86f49c-b358-446e-a580-5d625328693b Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Creating offline snapshot f4499d79-2765-4db3-b790-65d55c812592 of volume f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69d519f-bf71-447a-9a0c-51d52445507b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:56 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b Nov 05 22:22:56 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:57 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27" returned: 0 in 0.667s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 Nov 05 22:22:57 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:57 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 1G Nov 05 22:22:57 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Acquiring lock "cinder-198287a7-31fb-4549-a4ae-c1158c63b365-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Lock "cinder-198287a7-31fb-4549-a4ae-c1158c63b365-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Acquiring lock "cinder-quobyte-198287a7-31fb-4549-a4ae-c1158c63b365" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-198287a7-31fb-4549-a4ae-c1158c63b365" acquired by "delete_volume" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:57 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3591a7c1-f650-433a-9244-bbaa4bfa4c2b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841 Nov 05 22:22:57 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:57 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 1G" returned: 0 in 0.502s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2da8917-2de2-4e7a-bc6d-1268e500793b -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:57 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2da8917-2de2-4e7a-bc6d-1268e500793b -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 Nov 05 22:22:57 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:57 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 Nov 05 22:22:57 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:58 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27.223b5e38-1404-415a-871d-df5262286841" returned: 0 in 0.351s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-223b5e38-1404-415a-871d-df5262286841" released by "_delete_snapshot" :: held 2.214s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-25cb850f-9e3b-4532-85ec-2c85612abd27" released by "delete_snapshot" :: held 2.274s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:58 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2da8917-2de2-4e7a-bc6d-1268e500793b -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592" returned: 0 in 0.371s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:58 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365" returned: 0 in 0.444s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:58 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 Nov 05 22:22:58 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:58 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365 Nov 05 22:22:58 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['124e428a-2c7b-43a6-b83d-6a05a3792500', 'b9f5f9d0-f5dd-48ce-ace0-3595162a046c', '50bc4f08-278e-44bd-90d9-5c0ccd1c9d1d', '970f09d8-f18d-4d4c-9419-0d6dfaf10371'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Delete snapshot completed successfully. Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf1143bd-257d-419b-a99d-758f2c190358 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-223b5e38-1404-415a-871d-df5262286841-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:58 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592" returned: 0 in 0.338s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:58 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-198287a7-31fb-4549-a4ae-c1158c63b365" returned: 0 in 0.360s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.info Nov 05 22:22:58 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Lock "cinder-quobyte-198287a7-31fb-4549-a4ae-c1158c63b365" released by "delete_volume" :: held 0.889s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Created reservations ['8fc6a225-74c7-4386-848b-592fea72b830', '0bf89467-b6e9-46fb-a6a7-9b1b3934e7e0', '90483a11-c25a-4252-83dc-d10c2e349689', 'a3246271-b6b8-48e0-b4f7-3954686e14f3'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:58 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:22:58 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:58 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.info" returned: 0 in 0.345s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:58 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:22:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:58 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.info Nov 05 22:22:58 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:59 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.485s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:22:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Deleted volume successfully. Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e071bfdb-8fe2-48b1-b388-09243a214d39 tempest-VolumesExtendTest-956990523 None] Lock "cinder-198287a7-31fb-4549-a4ae-c1158c63b365-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:22:59 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.info" returned: 0 in 0.406s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Acquiring lock "cinder-quobyte-cc86f49c-b358-446e-a580-5d625328693b" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-25cb850f-9e3b-4532-85ec-2c85612abd27-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-25cb850f-9e3b-4532-85ec-2c85612abd27-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-cc86f49c-b358-446e-a580-5d625328693b" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] snapshot: f4499d79-2765-4db3-b790-65d55c812592, volume: cc86f49c-b358-446e-a580-5d625328693b, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb68317-6acc-4a7b-a83a-12bf5ec27ae8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-25cb850f-9e3b-4532-85ec-2c85612abd27" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-25cb850f-9e3b-4532-85ec-2c85612abd27" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8235d000-b884-4322-ad22-3295f8aa3dda]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:22:59 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 Nov 05 22:22:59 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:59 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 Nov 05 22:22:59 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:22:59 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592" returned: 0 in 0.555s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2da8917-2de2-4e7a-bc6d-1268e500793b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2eca55-d84d-4841-9077-6ce055848cbb]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:22:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:00 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27" returned: 0 in 0.562s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:00 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b Nov 05 22:23:00 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:00 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27 Nov 05 22:23:00 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:00 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b" returned: 0 in 0.470s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:00 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-25cb850f-9e3b-4532-85ec-2c85612abd27" returned: 0 in 0.383s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:00 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b Nov 05 22:23:00 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-25cb850f-9e3b-4532-85ec-2c85612abd27" released by "delete_volume" :: held 1.046s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['767108c2-0e45-4dbb-b781-be85912ac613', '122cf441-73f7-4d83-bb68-f979a5742bcf', '8573714c-70ea-44ec-b4a2-e638f7844f6c', 'e1ff3b07-6aca-48a8-8bda-cf0db852b0ed'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:00 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:23:00 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:01 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.503s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:01 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Deleted volume successfully. Nov 05 22:23:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064f16-4063-4744-b504-832e5d803b57 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-25cb850f-9e3b-4532-85ec-2c85612abd27-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (65f5b933-0693-4903-a98e-8bd56d9a029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1dbad0-fc7f-4eb1-9819-253e70d49d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1dbad0-fc7f-4eb1-9819-253e70d49d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-590330504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:03Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f2c15d-1c59-410b-8822-446ac6e9f73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f2c15d-1c59-410b-8822-446ac6e9f73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0310df-1ed2-4e1b-9a81-77935b79de4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0310df-1ed2-4e1b-9a81-77935b79de4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc', 'volume_name': 'volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3a4522-6bf2-4a4e-a320-bd5ee6961353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3a4522-6bf2-4a4e-a320-bd5ee6961353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275fb17c-2e7d-4f18-ae36-583d52b011a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:03 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Volume bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc', 'volume_size': 1} Nov 05 22:23:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:08 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b" returned: 0 in 7.966s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b, size 1024.00 MB, duration 7.97 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:23:08 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Converted 1024.00 MB image at 128.53 MB/s Nov 05 22:23:08 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b is being set with open permissions: ugo+rw: NotImplementedError Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:08 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b Nov 05 22:23:08 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:08 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b" returned: 0 in 0.246s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-cc86f49c-b358-446e-a580-5d625328693b" released by "_copy_volume_from_snapshot" :: held 9.345s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Acquiring lock "cinder-quobyte-f4499d79-2765-4db3-b790-65d55c812592" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-f4499d79-2765-4db3-b790-65d55c812592" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Deleting offline snapshot f4499d79-2765-4db3-b790-65d55c812592 of volume f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] snapshot_file for this snap is: volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1933ef4d-96bb-4dbe-b7a8-8fac2b0332c3]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:08 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 Nov 05 22:23:08 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:09 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592" returned: 0 in 0.415s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2da8917-2de2-4e7a-bc6d-1268e500793b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3829255-e856-4643-95e4-21cc44fa5695]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:09 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b Nov 05 22:23:09 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:09 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b" returned: 0 in 0.638s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:09 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 Nov 05 22:23:09 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:10 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:10 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592 Nov 05 22:23:10 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:10 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b.f4499d79-2765-4db3-b790-65d55c812592" returned: 0 in 0.281s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-f4499d79-2765-4db3-b790-65d55c812592" released by "_delete_snapshot" :: held 1.897s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.894s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.999s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-590330504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:03Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Creating volume bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:10 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:23:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:10 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc 1073741824 Nov 05 22:23:10 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f89e9e19-5115-4621-ab8a-f46b0ab335f1 tempest-GroupsV314Test-2090977082 None] Create group from source-group-771a7b37-79c5-4512-a3ec-e407903f7630 completed successfully. Nov 05 22:23:11 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc 1073741824" returned: 0 in 0.746s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:11 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc Nov 05 22:23:11 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:11 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" returned: 0 in 0.345s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275fb17c-2e7d-4f18-ae36-583d52b011a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e929ae-07c7-4b04-bcdc-f96d8e688a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Volume volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc (bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc): created successfully Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e929ae-07c7-4b04-bcdc-f96d8e688a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (65f5b933-0693-4903-a98e-8bd56d9a029f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f4dd6d56-a8e9-4e9d-bc7e-197d14dcf0c5 tempest-VolumesSnapshotTestJSON-262749634 None] Created volume successfully. Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Acquiring lock "cinder-quobyte-cc86f49c-b358-446e-a580-5d625328693b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-cc86f49c-b358-446e-a580-5d625328693b" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f396e03-4e6c-44a5-9e6c-81ca49699c74]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:12 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b Nov 05 22:23:12 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:12 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:12 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b Nov 05 22:23:12 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:12 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cc86f49c-b358-446e-a580-5d625328693b" returned: 0 in 0.246s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-cc86f49c-b358-446e-a580-5d625328693b" released by "delete_volume" :: held 0.722s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Created reservations ['57e5d813-ef7a-44ed-8e2b-caab55d33ff9'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:12 devstack cinder-volume[87085]: WARNING cinder.quota [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2022224381 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2022224381, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:23:12 devstack cinder-volume[87085]: WARNING cinder.quota [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2022224381 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2022224381, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Created reservations ['434fb277-b7a5-4e67-9db2-8b6078f71243', '6b8312fa-5ca5-4ea0-9e59-cbf56d4bad39', 'f7bb4cde-78ba-480e-8741-1674f0605e67', '6c82f69c-608a-4926-965c-c5b01a65a0fa'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:12 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:23:12 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Creating offline snapshot 1c0ff063-de17-46e1-8bab-a614244ee558 of volume bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd3cde2-14c3-4bf8-a120-b65947ed0e52]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:13 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.346s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-15f60507-d242-4dff-a962-e00de32e3bee tempest-GroupsV314Test-2090977082 None] Delete group completed successfully. Nov 05 22:23:13 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc Nov 05 22:23:13 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Acquiring lock "cinder-quobyte-f2da8917-2de2-4e7a-bc6d-1268e500793b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-f2da8917-2de2-4e7a-bc6d-1268e500793b" acquired by "delete_volume" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9471be1-31c1-4865-aab2-a0a2fdcf21e2]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:13 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" returned: 0 in 0.566s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:13 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b Nov 05 22:23:13 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:13 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 1G Nov 05 22:23:13 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:14 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b" returned: 0 in 0.539s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:14 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b Nov 05 22:23:14 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:14 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 1G" returned: 0 in 0.567s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:14 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 Nov 05 22:23:14 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:14 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f2da8917-2de2-4e7a-bc6d-1268e500793b" returned: 0 in 0.292s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Lock "cinder-quobyte-f2da8917-2de2-4e7a-bc6d-1268e500793b" released by "delete_volume" :: held 0.937s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Created reservations ['e35b8cfa-ded6-49ca-b1c1-32c206841bfb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Created reservations ['e7e449f3-5aad-4b19-bbca-90a12fed3101', 'da939536-15d1-461a-bcd9-fdabffbef66c', 'a6c677bc-7e1d-49ae-975f-aebb8abc5ceb', 'f601e04b-86cf-43cd-80aa-418710792c2a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:14 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558" returned: 0 in 0.342s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:14 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 is being set with open permissions: ugo+rw Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:14 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:23:14 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:14 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 Nov 05 22:23:14 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:14 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.301s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:14 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:14 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-796c480c-c224-4223-94a8-d477f45ce769 tempest-GroupsV314Test-2090977082 None] Delete group completed successfully. Nov 05 22:23:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558" returned: 0 in 0.301s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:15 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.info Nov 05 22:23:15 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:15 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.info" returned: 0 in 0.278s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:15 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.info is being set with open permissions: ugo+rw Nov 05 22:23:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:15 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.info Nov 05 22:23:15 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:15 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.info" returned: 0 in 0.305s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8207a081-ac45-42e0-96a4-e17e3fb355a0 tempest-VolumesSnapshotTestJSON-262749634 None] Create snapshot completed successfully Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (4d0da2e3-a3a3-4c61-9097-167b55097f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33a79c6-17a4-43c8-9679-e37577b477e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33a79c6-17a4-43c8-9679-e37577b477e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-452746605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7998f99-3ad2-4967-b1af-2fe0ae9b30b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12582204102e4e36a7b2e64f45f913e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c0ff063-de17-46e1-8bab-a614244ee558,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:17Z,use_quota=True,user_id='60b1605b75e94d28a12ccc2fad07c3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4781cd-a620-427c-91fd-3af1b6d48125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4781cd-a620-427c-91fd-3af1b6d48125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f96850-b41b-46d6-b0f1-15c5710d7438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f96850-b41b-46d6-b0f1-15c5710d7438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7998f99-3ad2-4967-b1af-2fe0ae9b30b3', 'volume_name': 'volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3', 'volume_size': 1, 'snapshot_id': '1c0ff063-de17-46e1-8bab-a614244ee558'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080e4423-4e37-4deb-a3a0-7d7e12518ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080e4423-4e37-4deb-a3a0-7d7e12518ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872ea6a-edac-4003-896e-accebc4b10b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:17 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Volume e7998f99-3ad2-4967-b1af-2fe0ae9b30b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3', 'volume_size': 1, 'snapshot_id': '1c0ff063-de17-46e1-8bab-a614244ee558'} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-1c0ff063-de17-46e1-8bab-a614244ee558-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-1c0ff063-de17-46e1-8bab-a614244ee558-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Creating volume e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 from snapshot 1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] snapshot: 1c0ff063-de17-46e1-8bab-a614244ee558, volume: e7998f99-3ad2-4967-b1af-2fe0ae9b30b3, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b7caf3-dd0e-427f-90c1-e8e8143ea161]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:17 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 Nov 05 22:23:17 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:17 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558" returned: 0 in 0.437s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dbac77-784b-4fff-9121-62640a738d15]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:17 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc Nov 05 22:23:17 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:18 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" returned: 0 in 0.413s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:23:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:23:18 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:23:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:18 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 Nov 05 22:23:18 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-b974733c-1d25-435d-be28-b9a3aa4f8c33 req-f9c07f22-71b5-4ad4-87db-e7f15021f047 tempest-AttachVolumeNegativeTest-1709425686 None] Terminate volume connection completed successfully. Nov 05 22:23:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b974733c-1d25-435d-be28-b9a3aa4f8c33 req-f9c07f22-71b5-4ad4-87db-e7f15021f047 tempest-AttachVolumeNegativeTest-1709425686 None] Deleting attachment 1ef1c8a8-e36d-4e0a-81cb-85c2ede20018. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:23:28 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" returned: 0 in 10.022s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc, size 1024.00 MB, duration 10.02 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:23:28 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Converted 1024.00 MB image at 102.17 MB/s Nov 05 22:23:28 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 is being set with open permissions: ugo+rw Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:28 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 Nov 05 22:23:28 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:28 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" returned: 0 in 0.360s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" released by "_copy_volume_from_snapshot" :: held 11.357s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-1c0ff063-de17-46e1-8bab-a614244ee558-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" released by "_create_volume_from_snapshot" :: held 11.466s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.482s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7872ea6a-edac-4003-896e-accebc4b10b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3', 'volume_size': 1, 'snapshot_id': '1c0ff063-de17-46e1-8bab-a614244ee558'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f68efda-d6cf-4ca1-afbf-a2fe9b95bcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:28 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Volume volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 (e7998f99-3ad2-4967-b1af-2fe0ae9b30b3): created successfully Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f68efda-d6cf-4ca1-afbf-a2fe9b95bcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Flow 'volume_create_manager' (4d0da2e3-a3a3-4c61-9097-167b55097f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fb37f9a8-bed1-4aea-a48c-6e0569acc566 tempest-VolumesSnapshotTestJSON-262749634 None] Created volume successfully. Nov 05 22:23:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cea2bc-e8ce-405b-9aae-7a87e443ed58]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:30 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 Nov 05 22:23:30 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:30 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" returned: 0 in 0.609s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:30 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3 Nov 05 22:23:30 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:31 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" returned: 0 in 0.600s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3" released by "delete_volume" :: held 1.302s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['dc8b1705-1acf-462e-8d11-e5024ee45614', '0060a755-13c8-4ed4-a3fd-ea2c49fffd68', 'ed012498-2104-4ad4-a0b8-50a8855a4bd6', '678f4045-2939-44bc-8dea-c1fa2f44a8ea'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:31 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:23:31 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:31 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Deleted volume successfully. Nov 05 22:23:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0dd37a61-6d4b-477a-89c8-fdcf1d37ed00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-e7998f99-3ad2-4967-b1af-2fe0ae9b30b3-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-1c0ff063-de17-46e1-8bab-a614244ee558-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-1c0ff063-de17-46e1-8bab-a614244ee558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-1c0ff063-de17-46e1-8bab-a614244ee558" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-1c0ff063-de17-46e1-8bab-a614244ee558" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Deleting offline snapshot 1c0ff063-de17-46e1-8bab-a614244ee558 of volume bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] snapshot_file for this snap is: volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[569673fd-76aa-4c7b-b188-fdeb7f8c9bdf]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:32 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 Nov 05 22:23:32 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:32 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558" returned: 0 in 0.512s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f1c71-b47f-477e-b80d-459c3e531372]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:32 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc Nov 05 22:23:32 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:33 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" returned: 0 in 0.744s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:33 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 Nov 05 22:23:33 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:33 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558" returned: 0 in 0.459s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:34 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558 Nov 05 22:23:34 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:34 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc.1c0ff063-de17-46e1-8bab-a614244ee558" returned: 0 in 0.277s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:34 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=99,cinder:DELETE=10,cinder:SELECT=90,cinder:INSERT=25 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:23:34 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:DELETE=5,cinder:SELECT=93,cinder:UPDATE=101,cinder:INSERT=20 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:23:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-1c0ff063-de17-46e1-8bab-a614244ee558" released by "_delete_snapshot" :: held 2.175s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" released by "delete_snapshot" :: held 2.208s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['64f75514-cd3d-4ab2-abb2-09a9b1c2e0c0', 'cfa42a38-e8af-41f2-977d-370f4d2e997a', '5fac0aee-e98e-4a93-a1d6-a83302631cda', 'c92bf0d5-d9af-423e-8590-11a03e50da5b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:34 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Delete snapshot completed successfully. Nov 05 22:23:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c500374e-b6f2-4307-94ed-ff184949dd9f tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-1c0ff063-de17-46e1-8bab-a614244ee558-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[981f0172-8536-4ba4-b862-0d505cf2d51a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:35 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc Nov 05 22:23:35 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:35 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" returned: 0 in 0.442s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:36 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc Nov 05 22:23:36 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:36 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" returned: 0 in 0.318s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc" released by "delete_volume" :: held 0.863s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['736dd18b-ef27-45b1-8b98-72047e3a902f', 'd2a51961-99a3-415d-ad48-198682b4a82a', 'f27c37ed-6d26-46ba-8770-b587cefbf60b', 'd8494301-fae8-43d6-a21c-8163bfd0062c'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:36 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:23:36 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-27320515-db1c-4536-ad0c-0f2559daafe8-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-27320515-db1c-4536-ad0c-0f2559daafe8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "cinder-quobyte-27320515-db1c-4536-ad0c-0f2559daafe8" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-27320515-db1c-4536-ad0c-0f2559daafe8" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[82793706-96a7-4144-9c85-5712a600d4b6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:36 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.384s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:36 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Deleted volume successfully. Nov 05 22:23:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ac776135-80b5-4dfa-8dd8-c09220c10d00 tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-bc7d1ce3-001f-4be1-a73a-1a62f5b29bfc-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:37 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 Nov 05 22:23:37 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:37 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8" returned: 0 in 0.530s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:37 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8 Nov 05 22:23:37 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:37 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-27320515-db1c-4536-ad0c-0f2559daafe8" returned: 0 in 0.397s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-quobyte-27320515-db1c-4536-ad0c-0f2559daafe8" released by "delete_volume" :: held 1.023s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Created reservations ['8c62071e-41a8-4cf1-bf79-4d11fc47a0da', 'fe51b58a-476d-49d5-87e2-e92e8db9ee49', '8315626d-0e17-41e6-a152-9090adb5b5ef', '337464df-2192-4a8c-87b2-b55b5a7b1619'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:38 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:23:38 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:38 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.410s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Deleted volume successfully. Nov 05 22:23:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a97061ec-ab01-4ed3-8cb3-924251f3bded tempest-VolumesSnapshotTestJSON-262749634 None] Lock "cinder-27320515-db1c-4536-ad0c-0f2559daafe8-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:40 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:23:40 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:40 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.426s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:23:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Flow 'volume_create_manager' (c133e5f7-22ff-4fa5-92dc-5b8c0ebe25e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e64fab1-0308-4975-ba32-8b0ac2f81118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e64fab1-0308-4975-ba32-8b0ac2f81118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1287164016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3834492-03ef-4f32-9f1c-0b42a7fa82ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='909207c391804571b6b463a753d63221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:42Z,use_quota=True,user_id='9067583f6c974531818c785cd0cd3259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4f70e6-9403-4d15-bf69-9a739f1d2356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4f70e6-9403-4d15-bf69-9a739f1d2356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70944dc6-41c9-4904-9175-a055cc16904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70944dc6-41c9-4904-9175-a055cc16904f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3834492-03ef-4f32-9f1c-0b42a7fa82ca', 'volume_name': 'volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366c39bf-524d-4c06-9667-6b34690ea4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (366c39bf-524d-4c06-9667-6b34690ea4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76de05b-31d0-4cce-b9e3-3eb677df3640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:42 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca', 'volume_size': 1} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1287164016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3834492-03ef-4f32-9f1c-0b42a7fa82ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='909207c391804571b6b463a753d63221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:42Z,use_quota=True,user_id='9067583f6c974531818c785cd0cd3259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Creating volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:42 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:23:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:42 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca 1073741824 Nov 05 22:23:42 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:43 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca 1073741824" returned: 0 in 0.700s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:43 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca Nov 05 22:23:43 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:43 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" returned: 0 in 0.424s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b76de05b-31d0-4cce-b9e3-3eb677df3640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5f12f0-229c-4601-bc5f-951196952a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:43 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Volume volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca (a3834492-03ef-4f32-9f1c-0b42a7fa82ca): created successfully Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5f12f0-229c-4601-bc5f-951196952a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Flow 'volume_create_manager' (c133e5f7-22ff-4fa5-92dc-5b8c0ebe25e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:43 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6eac8c95-1240-4747-93c9-efeb9d5b08de tempest-SnapshotsActionsTest-517112466 None] Created volume successfully. Nov 05 22:23:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:45 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Creating offline snapshot 8a8a24e3-d1a4-4063-b11e-5893f93cceef of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:23:45 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[543e1c9c-9c86-4b09-bb95-89477007514b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:45 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca Nov 05 22:23:45 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:46 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" returned: 0 in 0.927s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:46 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef 1G Nov 05 22:23:46 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Flow 'volume_create_manager' (e943c2a9-de64-4dda-bfb8-d88874525669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5aa8577-ccd0-49ea-8a40-55d474340c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:47 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5aa8577-ccd0-49ea-8a40-55d474340c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-959353511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562706b2-8044-455e-8806-e5f443e7634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42427c1e69401a81fc3e91b3a0a7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:47Z,use_quota=True,user_id='706475a6e63943eba05139d4645cd7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39e4bd2d-1ef9-4cb8-818f-5d7d74d38ec6),volume_type_id=39e4bd2d-1ef9-4cb8-818f-5d7d74d38ec6)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ce46e0-c1ca-41b5-a546-b50392c5ccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ce46e0-c1ca-41b5-a546-b50392c5ccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca45968d-5bc0-4486-a4a1-0d7bd0df9201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca45968d-5bc0-4486-a4a1-0d7bd0df9201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '562706b2-8044-455e-8806-e5f443e7634a', 'volume_name': 'volume-562706b2-8044-455e-8806-e5f443e7634a', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d196d85-7c1b-4e34-94fc-41b5bd5adef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d196d85-7c1b-4e34-94fc-41b5bd5adef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0172fc8-ef52-4d8f-9b3b-b2606b59d093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:47 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Volume 562706b2-8044-455e-8806-e5f443e7634a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-562706b2-8044-455e-8806-e5f443e7634a', 'volume_size': 1} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef 1G" returned: 0 in 1.088s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:47 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:23:47 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:47 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.506s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:47 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef is being set with open permissions: ugo+rw Nov 05 22:23:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:47 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:23:47 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Flow 'volume_create_manager' (9ca96cf6-93e8-4c96-996e-23b3df30b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83684eee-03b2-4209-8ed3-3074feb19ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83684eee-03b2-4209-8ed3-3074feb19ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609722455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3213e9d-30c8-4a4b-89e4-c150a99f6c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42427c1e69401a81fc3e91b3a0a7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:48Z,use_quota=True,user_id='706475a6e63943eba05139d4645cd7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db5ff887-d123-4cee-8e9f-c4fd0a41a220),volume_type_id=db5ff887-d123-4cee-8e9f-c4fd0a41a220)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d567e7-56ed-4424-8321-fe4b0e06ebe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d567e7-56ed-4424-8321-fe4b0e06ebe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11364b6e-e0f8-4f15-9e24-cc93113f2ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11364b6e-e0f8-4f15-9e24-cc93113f2ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3213e9d-30c8-4a4b-89e4-c150a99f6c80', 'volume_name': 'volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a4a7cd-81de-42a6-828f-eef41dc9a343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a4a7cd-81de-42a6-828f-eef41dc9a343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475b247b-0335-4d62-b211-4d0ae032fb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:48 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Volume b3213e9d-30c8-4a4b-89e4-c150a99f6c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80', 'volume_size': 1} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:48 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.668s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:48 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.info Nov 05 22:23:48 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:49 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.info" returned: 0 in 0.404s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:49 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.info is being set with open permissions: ugo+rw Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:49 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.info Nov 05 22:23:49 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Flow 'volume_create_manager' (4ed8e20c-5cad-440b-8c50-c2f03bd132db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8014b9d4-8224-4a40-ada4-98c3555950cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:49 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.info" returned: 0 in 0.600s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.409s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.300s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-959353511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562706b2-8044-455e-8806-e5f443e7634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42427c1e69401a81fc3e91b3a0a7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:47Z,use_quota=True,user_id='706475a6e63943eba05139d4645cd7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39e4bd2d-1ef9-4cb8-818f-5d7d74d38ec6),volume_type_id=39e4bd2d-1ef9-4cb8-818f-5d7d74d38ec6)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Creating volume 562706b2-8044-455e-8806-e5f443e7634a {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:49 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8014b9d4-8224-4a40-ada4-98c3555950cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-673536157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d807242-fb6b-4119-98e9-7078ae15f6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42427c1e69401a81fc3e91b3a0a7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:50Z,use_quota=True,user_id='706475a6e63943eba05139d4645cd7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f534f41-c2d5-436b-832b-fb9418e85a23),volume_type_id=0f534f41-c2d5-436b-832b-fb9418e85a23)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8123d0f4-33e8-4d93-a176-f33b4f561e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8123d0f4-33e8-4d93-a176-f33b4f561e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:49 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a 1073741824 Nov 05 22:23:49 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dce74b-fad1-46c4-ab62-25c7c93ba0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:49 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:23:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6faec865-d454-42e9-8ed4-4b6601533d91 tempest-SnapshotsActionsTest-517112466 None] Create snapshot completed successfully Nov 05 22:23:50 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a 1073741824" returned: 0 in 0.671s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40dce74b-fad1-46c4-ab62-25c7c93ba0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d807242-fb6b-4119-98e9-7078ae15f6ab', 'volume_name': 'volume-7d807242-fb6b-4119-98e9-7078ae15f6ab', 'volume_size': 1, 'image_id': 'f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1934169223', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d42427c1e69401a81fc3e91b3a0a7ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'created_at': datetime.datetime(2026, 11, 5, 21, 23, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 23, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de/file', 'properties': {}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8630e15-ad7c-404b-925d-537878780d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8630e15-ad7c-404b-925d-537878780d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a36adaf-69f7-48ca-9406-758b884b7e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:50 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Volume 7d807242-fb6b-4119-98e9-7078ae15f6ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d807242-fb6b-4119-98e9-7078ae15f6ab', 'volume_size': 1, 'image_id': 'f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1934169223', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d42427c1e69401a81fc3e91b3a0a7ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'created_at': datetime.datetime(2026, 11, 5, 21, 23, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 23, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de/file', 'properties': {}}, 'image_service': } Nov 05 22:23:50 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Trying to clone 7d807242-fb6b-4119-98e9-7078ae15f6ab from image f93687cc-c9c2-44e4-b7c5-64ad1b5722de at location (None, [{'url': 'file:///opt/stack/data/glance/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:23:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:50 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a Nov 05 22:23:50 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:51 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a" returned: 0 in 0.438s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.588s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1609722455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3213e9d-30c8-4a4b-89e4-c150a99f6c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42427c1e69401a81fc3e91b3a0a7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:48Z,use_quota=True,user_id='706475a6e63943eba05139d4645cd7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db5ff887-d123-4cee-8e9f-c4fd0a41a220),volume_type_id=db5ff887-d123-4cee-8e9f-c4fd0a41a220)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Creating volume b3213e9d-30c8-4a4b-89e4-c150a99f6c80 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:51 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0172fc8-ef52-4d8f-9b3b-b2606b59d093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-562706b2-8044-455e-8806-e5f443e7634a', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:51 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 1073741824 Nov 05 22:23:51 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab036205-1fa2-47ff-a1a2-a69673c3fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Volume volume-562706b2-8044-455e-8806-e5f443e7634a (562706b2-8044-455e-8806-e5f443e7634a): created successfully Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab036205-1fa2-47ff-a1a2-a69673c3fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Flow 'volume_create_manager' (e943c2a9-de64-4dda-bfb8-d88874525669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6356aa05-d867-4d52-bd17-6d43f1ce75bd tempest-TestInstancesWithCinderVolumes-741687458 None] Created volume successfully. Nov 05 22:23:51 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 1073741824" returned: 0 in 0.920s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:52 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 Nov 05 22:23:52 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:52 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80" returned: 0 in 0.322s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.264s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Creating offline snapshot 99617392-7594-45ce-8538-92368cc64b1d of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475b247b-0335-4d62-b211-4d0ae032fb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938f9b1-61c7-4566-abdb-d74324e8069b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfddba17-cef3-47d7-ae87-acda6ef1d872]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:52 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Volume volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 (b3213e9d-30c8-4a4b-89e4-c150a99f6c80): created successfully Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938f9b1-61c7-4566-abdb-d74324e8069b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:23:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Flow 'volume_create_manager' (9ca96cf6-93e8-4c96-996e-23b3df30b178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:23:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c04c68e9-fad1-4626-b73c-410079a68c9d tempest-TestInstancesWithCinderVolumes-741687458 None] Created volume successfully. Nov 05 22:23:52 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:23:52 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:53 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.792s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:53 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d 1G Nov 05 22:23:53 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:53 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d 1G" returned: 0 in 0.577s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:53 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d Nov 05 22:23:53 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:54 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d" returned: 0 in 0.520s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:54 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d is being set with open permissions: ugo+rw Nov 05 22:23:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:54 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d Nov 05 22:23:54 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:54 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d" returned: 0 in 0.325s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-93a31bea-e103-483d-a564-bfc6ceaeaaf1 tempest-SnapshotsActionsTest-517112466 None] Create snapshot completed successfully Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD, size 20.69 MB, duration 4.91 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:23:55 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Image download 20.69 MB at 4.22 MB/s Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d8f5f7-0de2-41c5-a714-d6037efd5680]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-99617392-7594-45ce-8538-92368cc64b1d-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-99617392-7594-45ce-8538-92368cc64b1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-99617392-7594-45ce-8538-92368cc64b1d" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-99617392-7594-45ce-8538-92368cc64b1d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Deleting offline snapshot 99617392-7594-45ce-8538-92368cc64b1d of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] snapshot_file for this snap is: volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25e741-cd42-413f-bc45-085400687fe5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:55 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD Nov 05 22:23:55 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:55 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d Nov 05 22:23:55 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:55 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:55 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Temporary image f93687cc-c9c2-44e4-b7c5-64ad1b5722de is fetched for user 706475a6e63943eba05139d4645cd7f4. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb839394-e93f-49b0-8c39-3057fe93972a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:56 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d" returned: 0 in 0.607s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:56 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD Nov 05 22:23:56 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8833e18-3ed9-4160-aacf-7d4a6a553763]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:56 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:23:56 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:56 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-673536157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d807242-fb6b-4119-98e9-7078ae15f6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d42427c1e69401a81fc3e91b3a0a7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:23:50Z,use_quota=True,user_id='706475a6e63943eba05139d4645cd7f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f534f41-c2d5-436b-832b-fb9418e85a23),volume_type_id=0f534f41-c2d5-436b-832b-fb9418e85a23)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Creating volume 7d807242-fb6b-4119-98e9-7078ae15f6ab {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:23:56 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:56 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab 1073741824 Nov 05 22:23:56 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:56 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.438s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:56 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d Nov 05 22:23:56 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:57 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab 1073741824" returned: 0 in 0.563s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:57 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab Nov 05 22:23:57 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:57 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d" returned: 0 in 0.485s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:57 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d Nov 05 22:23:57 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:57 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab" returned: 0 in 0.556s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Attempting download of f93687cc-c9c2-44e4-b7c5-64ad1b5722de ((None, [{'url': 'file:///opt/stack/data/glance/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'metadata': {}}])) to volume 7d807242-fb6b-4119-98e9-7078ae15f6ab. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:23:57 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.99617392-7594-45ce-8538-92368cc64b1d" returned: 0 in 0.555s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-99617392-7594-45ce-8538-92368cc64b1d" released by "_delete_snapshot" :: held 2.239s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" released by "delete_snapshot" :: held 2.276s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7750af48-b615-4a47-9276-52a5991136e8]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_prj47xuy {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:57 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Created reservations ['aaa11d55-bf5b-4a88-8ae3-c88c36d30edc', 'bd4d366d-36fa-4734-97fb-c2b05e616948', '7d36e7fa-5ca0-41f1-85da-a08938474738', '5a792fcf-ec63-46ff-933c-dbf7dfbd134c'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:23:57 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_prj47xuy Nov 05 22:23:57 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Delete snapshot completed successfully. Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bfe280f-e11c-48e1-b4ce-bd061dfa2afb tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-99617392-7594-45ce-8538-92368cc64b1d-delete_snapshot" released by "delete_snapshot" :: held 2.465s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:23:58 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_prj47xuy" returned: 0 in 0.360s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_prj47xuy {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:58 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_prj47xuy Nov 05 22:23:58 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:58 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_prj47xuy" returned: 1 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_prj47xuy' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[992abc00-dd75-473f-865c-3bee91c5a172]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:58 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD Nov 05 22:23:58 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:58 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] f93687cc-c9c2-44e4-b7c5-64ad1b5722de was qcow2, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:23:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:59 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab Nov 05 22:23:59 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Creating offline snapshot f355a5b8-5443-4a1f-a038-ff411b625535 of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae824e61-8d66-40d0-b4bd-db7744b6364a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:59 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:23:59 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:23:59 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.499s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:23:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:23:59 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 1G Nov 05 22:23:59 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:00 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 1G" returned: 0 in 0.739s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:00 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 Nov 05 22:24:00 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:00 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:00 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 is being set with open permissions: ugo+rw Nov 05 22:24:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:00 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 Nov 05 22:24:00 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:01 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-390de102-38f3-4c3b-b6d3-e4b9b4205242 tempest-SnapshotsActionsTest-517112466 None] Create snapshot completed successfully Nov 05 22:24:01 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab" returned: 0 in 2.530s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f93687cc-c9c2-44e4-b7c5-64ad1b5722de_fgi7mv1vdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:24:01 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Converted 112.00 MB image at 44.24 MB/s Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:01 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab 1G Nov 05 22:24:01 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:01 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab 1G" returned: 0 in 0.386s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Downloaded image f93687cc-c9c2-44e4-b7c5-64ad1b5722de ((None, [{'url': 'file:///opt/stack/data/glance/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'metadata': {}}])) to volume 7d807242-fb6b-4119-98e9-7078ae15f6ab successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Temporary image f93687cc-c9c2-44e4-b7c5-64ad1b5722de for user 706475a6e63943eba05139d4645cd7f4 is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Marking volume 7d807242-fb6b-4119-98e9-7078ae15f6ab as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Copying metadata from image f93687cc-c9c2-44e4-b7c5-64ad1b5722de to 7d807242-fb6b-4119-98e9-7078ae15f6ab. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Creating volume glance metadata for volume 7d807242-fb6b-4119-98e9-7078ae15f6ab backed by image f93687cc-c9c2-44e4-b7c5-64ad1b5722de with: {'image_id': 'f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'image_name': 'tempest-scenario-img--1934169223', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:24:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a36adaf-69f7-48ca-9406-758b884b7e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d807242-fb6b-4119-98e9-7078ae15f6ab', 'volume_size': 1, 'image_id': 'f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1934169223', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3d42427c1e69401a81fc3e91b3a0a7ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f93687cc-c9c2-44e4-b7c5-64ad1b5722de', 'created_at': datetime.datetime(2026, 11, 5, 21, 23, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 23, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f93687cc-c9c2-44e4-b7c5-64ad1b5722de/file', 'properties': {}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0a5c1d-dd9f-41f3-8086-7e9b34efcb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Volume volume-7d807242-fb6b-4119-98e9-7078ae15f6ab (7d807242-fb6b-4119-98e9-7078ae15f6ab): created successfully Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0a5c1d-dd9f-41f3-8086-7e9b34efcb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Flow 'volume_create_manager' (4ed8e20c-5cad-440b-8c50-c2f03bd132db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ca8d1692-02d8-4339-804d-383c7a746397 tempest-TestInstancesWithCinderVolumes-741687458 None] Created volume successfully. Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-f355a5b8-5443-4a1f-a038-ff411b625535-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-f355a5b8-5443-4a1f-a038-ff411b625535-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-f355a5b8-5443-4a1f-a038-ff411b625535" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-f355a5b8-5443-4a1f-a038-ff411b625535" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Deleting offline snapshot f355a5b8-5443-4a1f-a038-ff411b625535 of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] snapshot_file for this snap is: volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3037156-ca3b-41fa-8a00-98a11ff46330]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:02 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 Nov 05 22:24:02 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:03 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535" returned: 0 in 0.398s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc04412-a861-467b-964a-8e885a214a23]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:03 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:03 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:03 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.409s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:03 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 Nov 05 22:24:03 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:03 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535" returned: 0 in 0.505s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:04 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535 Nov 05 22:24:04 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:04 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.f355a5b8-5443-4a1f-a038-ff411b625535" returned: 0 in 0.281s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-f355a5b8-5443-4a1f-a038-ff411b625535" released by "_delete_snapshot" :: held 1.746s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" released by "delete_snapshot" :: held 1.788s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:04 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Created reservations ['a1df3be6-f0a4-452f-b8d1-20ef76e54ac5', '6b8cfb15-de43-4baa-9e03-4c964011b2fd', '2ad56c49-f0c1-47fb-9b83-210c15debf78', 'c3c9af74-73b8-4c5d-a756-748de3a6f108'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Delete snapshot completed successfully. Nov 05 22:24:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1ba1fd41-062e-46fb-acb7-20bcd246ed27 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-f355a5b8-5443-4a1f-a038-ff411b625535-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Creating offline snapshot effcb14d-87cd-4ac5-879e-775901596c8f of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9257001-391f-48bf-ac84-82a7a46ae3f1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:05 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:05 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:05 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.565s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:05 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f 1G Nov 05 22:24:05 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8114b798-b9ff-4c16-a509-0c9668a640fa req-affe1d3e-d1f1-414b-9087-2272bb6b8349 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:06 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f 1G" returned: 0 in 0.745s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:06 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f Nov 05 22:24:06 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:07 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f" returned: 0 in 0.528s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:07 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f is being set with open permissions: ugo+rw Nov 05 22:24:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:07 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f Nov 05 22:24:07 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:07 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f" returned: 0 in 0.314s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8114b798-b9ff-4c16-a509-0c9668a640fa req-affe1d3e-d1f1-414b-9087-2272bb6b8349 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.097s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8114b798-b9ff-4c16-a509-0c9668a640fa req-affe1d3e-d1f1-414b-9087-2272bb6b8349 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-999811d4-fe23-4e05-bc9f-c89004886c0b tempest-SnapshotsActionsTest-517112466 None] Create snapshot completed successfully Nov 05 22:24:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-8114b798-b9ff-4c16-a509-0c9668a640fa req-affe1d3e-d1f1-414b-9087-2272bb6b8349 tempest-TestInstancesWithCinderVolumes-741687458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-7d807242-fb6b-4119-98e9-7078ae15f6ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdb48c17-3caa-46cd-8e1a-6e47ab85d18e', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:24:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-8114b798-b9ff-4c16-a509-0c9668a640fa req-affe1d3e-d1f1-414b-9087-2272bb6b8349 tempest-TestInstancesWithCinderVolumes-741687458 None] attachment_update completed successfully. Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-effcb14d-87cd-4ac5-879e-775901596c8f-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-effcb14d-87cd-4ac5-879e-775901596c8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-effcb14d-87cd-4ac5-879e-775901596c8f" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-effcb14d-87cd-4ac5-879e-775901596c8f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Deleting offline snapshot effcb14d-87cd-4ac5-879e-775901596c8f of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] snapshot_file for this snap is: volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a5bf8-ae8f-412c-b140-891333d1798e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:09 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f Nov 05 22:24:09 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f" returned: 0 in 0.656s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:09 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d955a875-5c3a-476e-a7b9-b8179f9f9d6b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:09 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:09 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Flow 'volume_create_manager' (a86f5a69-8cd5-44a8-a6e2-1783559e36e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f6574a-9351-4d78-8b9a-6a09042d157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f6574a-9351-4d78-8b9a-6a09042d157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-188404298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36708096-c8bc-4c60-9db7-e7f95dbac21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5119806ecb042268bf4053a59d63534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:10Z,use_quota=True,user_id='af3d393d7ca2437c8b18514217e8fb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee12a65f-ad71-46ff-b796-306b7f27e672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee12a65f-ad71-46ff-b796-306b7f27e672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb51d1ee-7568-4384-8138-b32fcd8cca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:10 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb51d1ee-7568-4384-8138-b32fcd8cca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36708096-c8bc-4c60-9db7-e7f95dbac21a', 'volume_name': 'volume-36708096-c8bc-4c60-9db7-e7f95dbac21a', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0427b20c-3cfb-48d3-a5d3-f07c491b9938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0427b20c-3cfb-48d3-a5d3-f07c491b9938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d2c135-868d-4831-ba38-dc7536534424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Volume 36708096-c8bc-4c60-9db7-e7f95dbac21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36708096-c8bc-4c60-9db7-e7f95dbac21a', 'volume_size': 1} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-188404298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36708096-c8bc-4c60-9db7-e7f95dbac21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5119806ecb042268bf4053a59d63534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:10Z,use_quota=True,user_id='af3d393d7ca2437c8b18514217e8fb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Creating volume 36708096-c8bc-4c60-9db7-e7f95dbac21a {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:10 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 1.087s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:10 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a 1073741824 Nov 05 22:24:10 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:10 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f Nov 05 22:24:10 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:11 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f" returned: 0 in 0.888s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:11 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f Nov 05 22:24:11 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:11 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a 1073741824" returned: 0 in 0.979s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:11 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a Nov 05 22:24:11 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:12 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.effcb14d-87cd-4ac5-879e-775901596c8f" returned: 0 in 0.540s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-effcb14d-87cd-4ac5-879e-775901596c8f" released by "_delete_snapshot" :: held 3.340s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" released by "delete_snapshot" :: held 3.381s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Created reservations ['efedb0b2-19dc-46fc-977e-de074b901fd7', '3f20f827-d93f-44ed-956d-4a7feb5972ec', '1c2de2fa-236a-4cd8-9a30-c8b67d9194ab', 'd58f8b0a-634e-4f37-a477-2ffc3bea2631'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:12 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a" returned: 0 in 0.619s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d2c135-868d-4831-ba38-dc7536534424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36708096-c8bc-4c60-9db7-e7f95dbac21a', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f92af0-6309-4107-ae42-a651e9f46d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Volume volume-36708096-c8bc-4c60-9db7-e7f95dbac21a (36708096-c8bc-4c60-9db7-e7f95dbac21a): created successfully Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f92af0-6309-4107-ae42-a651e9f46d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Flow 'volume_create_manager' (a86f5a69-8cd5-44a8-a6e2-1783559e36e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:12 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cec98529-7fdf-434f-bfd7-7a228542fc29 tempest-AttachVolumeNegativeTest-1709425686 None] Created volume successfully. Nov 05 22:24:12 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Delete snapshot completed successfully. Nov 05 22:24:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dff2c087-b0c0-426d-9165-d9b976601ae8 tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-effcb14d-87cd-4ac5-879e-775901596c8f-delete_snapshot" released by "delete_snapshot" :: held 3.778s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Creating offline snapshot 24e0f83c-7cfb-4011-b276-5fb53319c228 of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:24:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2a353-5b9a-48e1-976e-517dad1a0eff]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:14 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:14 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:14 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.795s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:14 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 1G Nov 05 22:24:14 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6d8dbbfc-2e42-4fe3-8a83-7cf6399f17f0 req-90f92334-d362-4a8a-b059-7f3be43d7e98 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:15 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 1G" returned: 0 in 0.870s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:15 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 Nov 05 22:24:15 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:16 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228" returned: 0 in 0.500s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:16 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 is being set with open permissions: ugo+rw Nov 05 22:24:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:16 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 Nov 05 22:24:16 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:16 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228" returned: 0 in 0.446s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6d8dbbfc-2e42-4fe3-8a83-7cf6399f17f0 req-90f92334-d362-4a8a-b059-7f3be43d7e98 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.649s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-6d8dbbfc-2e42-4fe3-8a83-7cf6399f17f0 req-90f92334-d362-4a8a-b059-7f3be43d7e98 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b7042c35-565b-4da6-b81d-7253368b15be tempest-SnapshotsActionsTest-517112466 None] Create snapshot completed successfully Nov 05 22:24:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-6d8dbbfc-2e42-4fe3-8a83-7cf6399f17f0 req-90f92334-d362-4a8a-b059-7f3be43d7e98 tempest-AttachVolumeNegativeTest-1709425686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-36708096-c8bc-4c60-9db7-e7f95dbac21a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '502b5982-755d-4adb-bb40-71a50d332af0', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:24:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-6d8dbbfc-2e42-4fe3-8a83-7cf6399f17f0 req-90f92334-d362-4a8a-b059-7f3be43d7e98 tempest-AttachVolumeNegativeTest-1709425686 None] attachment_update completed successfully. Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-24e0f83c-7cfb-4011-b276-5fb53319c228-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-24e0f83c-7cfb-4011-b276-5fb53319c228-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Acquiring lock "cinder-quobyte-24e0f83c-7cfb-4011-b276-5fb53319c228" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-24e0f83c-7cfb-4011-b276-5fb53319c228" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Deleting offline snapshot 24e0f83c-7cfb-4011-b276-5fb53319c228 of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] snapshot_file for this snap is: volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae14bf2-63a0-41d0-99a5-9b335320822f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:17 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 Nov 05 22:24:17 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:18 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228" returned: 0 in 0.832s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:18 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[01735c1a-abad-4b58-a2ac-c1ee8a2a32b6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:18 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:18 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:19 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.710s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:19 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 Nov 05 22:24:19 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:19 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-7cd116d9-fb87-46a4-9905-ff447c21259c req-7f01ac62-3167-4bd0-b4df-fbfa07fcf2c7 tempest-AttachVolumeNegativeTest-1709425686 None] Terminate volume connection completed successfully. Nov 05 22:24:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-7cd116d9-fb87-46a4-9905-ff447c21259c req-7f01ac62-3167-4bd0-b4df-fbfa07fcf2c7 tempest-AttachVolumeNegativeTest-1709425686 None] Deleting attachment 502b5982-755d-4adb-bb40-71a50d332af0. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:24:19 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228" returned: 0 in 0.792s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:20 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228 Nov 05 22:24:20 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:20 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.24e0f83c-7cfb-4011-b276-5fb53319c228" returned: 0 in 0.464s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-24e0f83c-7cfb-4011-b276-5fb53319c228" released by "_delete_snapshot" :: held 3.029s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" released by "delete_snapshot" :: held 3.087s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Created reservations ['f359ae98-4966-4934-a449-51a8c70fcbb1', 'ad07de0f-a838-4a4a-9d2a-9fffb57f375f', 'd6845cf2-8771-4a67-93c5-3a69be9cdac5', '15aadf49-f387-40fd-98d4-5f8195b861db'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Delete snapshot completed successfully. Nov 05 22:24:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b365767-bab5-40b7-8162-7a247ff9a26c tempest-SnapshotsActionsTest-816814451 None] Lock "cinder-24e0f83c-7cfb-4011-b276-5fb53319c228-delete_snapshot" released by "delete_snapshot" :: held 3.503s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "cinder-8a8a24e3-d1a4-4063-b11e-5893f93cceef-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-8a8a24e3-d1a4-4063-b11e-5893f93cceef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "cinder-quobyte-8a8a24e3-d1a4-4063-b11e-5893f93cceef" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-quobyte-8a8a24e3-d1a4-4063-b11e-5893f93cceef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Deleting offline snapshot 8a8a24e3-d1a4-4063-b11e-5893f93cceef of volume a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] snapshot_file for this snap is: volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cdb4f3-3dfc-4840-97d8-3d9e67831184]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:23 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:23 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:23 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.597s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:24:23 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1893538d-47f7-4b82-910f-2c015c900a6d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:23 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca Nov 05 22:24:23 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:24 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" returned: 0 in 0.901s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:24 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:24 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:25 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.747s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:25 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef Nov 05 22:24:25 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:25 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca.8a8a24e3-d1a4-4063-b11e-5893f93cceef" returned: 0 in 0.433s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-quobyte-8a8a24e3-d1a4-4063-b11e-5893f93cceef" released by "_delete_snapshot" :: held 2.910s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" released by "delete_snapshot" :: held 2.943s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:25 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Created reservations ['64ead3a2-4ee6-4158-9bd9-f54021eed917', '9394cff5-9467-49b5-aba8-a986e81b3575', 'fabc0fdd-f236-4ec2-8e50-7e15e1ab8486', 'fba2df15-8bbf-4734-baf2-b946d8c1f797'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Delete snapshot completed successfully. Nov 05 22:24:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63470a33-ec56-4295-8e00-fb67572a1760 tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-8a8a24e3-d1a4-4063-b11e-5893f93cceef-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "cinder-a3834492-03ef-4f32-9f1c-0b42a7fa82ca-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-a3834492-03ef-4f32-9f1c-0b42a7fa82ca-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:26 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1117973-4095-490e-aa5c-fb11941aaf46]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:26 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca Nov 05 22:24:26 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:27 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" returned: 0 in 0.766s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:27 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca Nov 05 22:24:27 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:27 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" returned: 0 in 0.457s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-quobyte-a3834492-03ef-4f32-9f1c-0b42a7fa82ca" released by "delete_volume" :: held 1.316s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:27 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Created reservations ['914882af-7d8d-4aa7-a5ac-21895d6ded2a', '9d2e1dad-c1d9-4a1e-b004-0a7145874aba', 'a6928ba9-5e93-46b1-9bfc-3125ec758f39', '6f1daf7a-0c2a-402d-a560-9e45e979ad55'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:28 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:24:28 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:28 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.425s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Deleted volume successfully. Nov 05 22:24:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4fe84b48-6e22-4123-993a-609075914daf tempest-SnapshotsActionsTest-517112466 None] Lock "cinder-a3834492-03ef-4f32-9f1c-0b42a7fa82ca-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:38 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=90,cinder:INSERT=24,cinder:UPDATE=72,cinder:DELETE=3 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:24:38 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=83,cinder:INSERT=27,cinder:UPDATE=93,cinder:DELETE=10 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Flow 'volume_create_manager' (7bda6250-ae2d-4977-9ba5-a0de99239951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a048db21-2a01-4819-aaa5-44077a687bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a048db21-2a01-4819-aaa5-44077a687bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1935201981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f6689b-8bed-4363-911f-503fefc89f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da4870b8fbc40de87082ae74d25a6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:39Z,use_quota=True,user_id='0345449cce4247ee897524f469f9e247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bfc7d5-7990-43f8-8022-bc33f8ee4b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bfc7d5-7990-43f8-8022-bc33f8ee4b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739069a8-a302-4301-8c44-7ef81c15f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739069a8-a302-4301-8c44-7ef81c15f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f6689b-8bed-4363-911f-503fefc89f6f', 'volume_name': 'volume-80f6689b-8bed-4363-911f-503fefc89f6f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73780e1a-9aeb-4f82-9235-34a760bbd387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73780e1a-9aeb-4f82-9235-34a760bbd387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798f1d96-9088-4c08-8c1d-03efc034185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:39 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Volume 80f6689b-8bed-4363-911f-503fefc89f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f6689b-8bed-4363-911f-503fefc89f6f', 'volume_size': 1} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1935201981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f6689b-8bed-4363-911f-503fefc89f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da4870b8fbc40de87082ae74d25a6d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:39Z,use_quota=True,user_id='0345449cce4247ee897524f469f9e247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Creating volume 80f6689b-8bed-4363-911f-503fefc89f6f {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:39 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:24:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:39 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f 1073741824 Nov 05 22:24:39 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:40 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f 1073741824" returned: 0 in 0.886s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:40 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f Nov 05 22:24:40 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:40 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:24:40 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:40 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.529s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:24:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:24:41 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f" returned: 0 in 1.028s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798f1d96-9088-4c08-8c1d-03efc034185e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f6689b-8bed-4363-911f-503fefc89f6f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca611c90-3317-40e5-91b3-4bbb99373143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:41 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Volume volume-80f6689b-8bed-4363-911f-503fefc89f6f (80f6689b-8bed-4363-911f-503fefc89f6f): created successfully Nov 05 22:24:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca611c90-3317-40e5-91b3-4bbb99373143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Flow 'volume_create_manager' (7bda6250-ae2d-4977-9ba5-a0de99239951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a69875cc-ca7b-4e50-bd22-15431d23592f tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Created volume successfully. Nov 05 22:24:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8fefc077-e459-4079-8c2a-d2befd81895f req-b739fa49-04e7-494c-b5d8-b18a4860bfce tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8fefc077-e459-4079-8c2a-d2befd81895f req-b739fa49-04e7-494c-b5d8-b18a4860bfce tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-8fefc077-e459-4079-8c2a-d2befd81895f req-b739fa49-04e7-494c-b5d8-b18a4860bfce tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-8fefc077-e459-4079-8c2a-d2befd81895f req-b739fa49-04e7-494c-b5d8-b18a4860bfce tempest-TestInstancesWithCinderVolumes-741687458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-562706b2-8044-455e-8806-e5f443e7634a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98d9fffc-d434-4248-94c7-1dc6c0c2ace2', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:24:43 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-8fefc077-e459-4079-8c2a-d2befd81895f req-b739fa49-04e7-494c-b5d8-b18a4860bfce tempest-TestInstancesWithCinderVolumes-741687458 None] attachment_update completed successfully. Nov 05 22:24:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Acquiring lock "cinder-80f6689b-8bed-4363-911f-503fefc89f6f-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "cinder-80f6689b-8bed-4363-911f-503fefc89f6f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Acquiring lock "cinder-quobyte-80f6689b-8bed-4363-911f-503fefc89f6f" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "cinder-quobyte-80f6689b-8bed-4363-911f-503fefc89f6f" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:45 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5030d3aa-f8a8-4674-b20d-cc55f0ff8d33]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:45 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f Nov 05 22:24:45 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:45 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f" returned: 0 in 0.705s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:46 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f Nov 05 22:24:46 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:46 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-80f6689b-8bed-4363-911f-503fefc89f6f" returned: 0 in 0.631s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "cinder-quobyte-80f6689b-8bed-4363-911f-503fefc89f6f" released by "delete_volume" :: held 1.434s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:46 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Created reservations ['83090381-be28-4902-9baa-1bb552f921c6', '264fe331-cad6-431d-9366-bed6567bc4bc', '51783c34-c88a-49f6-a53a-f4a8d6b3a975', '00c859ab-af8b-4991-8fa8-817dcb044014'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:47 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:24:47 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:47 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.886s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Deleted volume successfully. Nov 05 22:24:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a40e9ea-1f8e-40f5-a839-dfe1ca8cb54d tempest-VolumeQuotasNegativeTestJSON-1899599483 None] Lock "cinder-80f6689b-8bed-4363-911f-503fefc89f6f-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-3b5daaf1-00ee-407f-9a94-0b4b05302efb req-2c6ec738-947a-4dc4-8b0c-5481ef0482f7 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-3b5daaf1-00ee-407f-9a94-0b4b05302efb req-2c6ec738-947a-4dc4-8b0c-5481ef0482f7 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-3b5daaf1-00ee-407f-9a94-0b4b05302efb req-2c6ec738-947a-4dc4-8b0c-5481ef0482f7 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-3b5daaf1-00ee-407f-9a94-0b4b05302efb req-2c6ec738-947a-4dc4-8b0c-5481ef0482f7 tempest-TestInstancesWithCinderVolumes-741687458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8dfb8449-d386-4f38-b703-b91aa979ac59', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:24:48 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-3b5daaf1-00ee-407f-9a94-0b4b05302efb req-2c6ec738-947a-4dc4-8b0c-5481ef0482f7 tempest-TestInstancesWithCinderVolumes-741687458 None] attachment_update completed successfully. Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Flow 'volume_create_manager' (02c8b7a6-8c30-445e-a26e-cbc14271a16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2c2376-8b77-4fb1-8f01-59b12c0e1de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2c2376-8b77-4fb1-8f01-59b12c0e1de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-451657724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15f7768-ed48-430f-94bd-577890d64ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eacf832e230a45a2b1c5777f85275559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:54Z,use_quota=True,user_id='ec9ab30012a64d238ca0ce3ac42d6223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdcc075-8b8c-4ed6-b2f0-9f9928e08723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdcc075-8b8c-4ed6-b2f0-9f9928e08723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c361ad2c-4058-4422-b1c5-1b7d7847fe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c361ad2c-4058-4422-b1c5-1b7d7847fe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15f7768-ed48-430f-94bd-577890d64ede', 'volume_name': 'volume-f15f7768-ed48-430f-94bd-577890d64ede', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc4b226-340d-465c-8a67-383860d13f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc4b226-340d-465c-8a67-383860d13f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4eb7a29-b7f6-440d-86d7-a92b01c9d186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Volume f15f7768-ed48-430f-94bd-577890d64ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15f7768-ed48-430f-94bd-577890d64ede', 'volume_size': 1} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-451657724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15f7768-ed48-430f-94bd-577890d64ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eacf832e230a45a2b1c5777f85275559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:24:54Z,use_quota=True,user_id='ec9ab30012a64d238ca0ce3ac42d6223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Creating volume f15f7768-ed48-430f-94bd-577890d64ede {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:24:54 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:54 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede 1073741824 Nov 05 22:24:54 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-91b83cb0-b556-4bfd-bc23-ab199b243e6f req-e7baccc5-461d-44e1-a1e1-be9efbe45e69 tempest-TestInstancesWithCinderVolumes-741687458 None] Terminate volume connection completed successfully. Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-91b83cb0-b556-4bfd-bc23-ab199b243e6f req-e7baccc5-461d-44e1-a1e1-be9efbe45e69 tempest-TestInstancesWithCinderVolumes-741687458 None] Deleting attachment 98d9fffc-d434-4248-94c7-1dc6c0c2ace2. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:24:54 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede 1073741824" returned: 0 in 0.470s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:54 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede Nov 05 22:24:54 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:55 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede" returned: 0 in 0.265s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4eb7a29-b7f6-440d-86d7-a92b01c9d186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15f7768-ed48-430f-94bd-577890d64ede', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec590c9-7042-49cd-bf8b-07ff894d75ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:24:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Volume volume-f15f7768-ed48-430f-94bd-577890d64ede (f15f7768-ed48-430f-94bd-577890d64ede): created successfully Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec590c9-7042-49cd-bf8b-07ff894d75ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Flow 'volume_create_manager' (02c8b7a6-8c30-445e-a26e-cbc14271a16f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:24:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-18b175e5-04f5-421b-9b8c-3c0fd75d320e tempest-VolumesMetadataTest-1349386570 None] Created volume successfully. Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "cinder-562706b2-8044-455e-8806-e5f443e7634a-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-562706b2-8044-455e-8806-e5f443e7634a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "cinder-quobyte-562706b2-8044-455e-8806-e5f443e7634a" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-quobyte-562706b2-8044-455e-8806-e5f443e7634a" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35f0bf8-094a-4131-a922-9e57d8653f6b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:55 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a Nov 05 22:24:55 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:55 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a" returned: 0 in 0.421s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:55 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a Nov 05 22:24:55 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:56 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-562706b2-8044-455e-8806-e5f443e7634a" returned: 0 in 0.270s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-quobyte-562706b2-8044-455e-8806-e5f443e7634a" released by "delete_volume" :: held 0.743s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:56 devstack cinder-volume[87085]: WARNING cinder.quota [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156270912-1453350032 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156270912-1453350032, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:24:56 devstack cinder-volume[87085]: WARNING cinder.quota [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156270912-1453350032 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-156270912-1453350032, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Created reservations ['b008f68a-e531-44f6-a36b-04475bf93915', '00396374-76b2-4c0d-8a77-7668aea2959f', '0a817316-d709-4800-b818-bbadd7d8dc96', '2eaa6e7f-022d-4410-ba57-1cd4b2a927f2'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:56 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:24:56 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:56 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.469s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:56 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Deleted volume successfully. Nov 05 22:24:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc480967-af05-4f29-bfa5-20d8ae118907 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-562706b2-8044-455e-8806-e5f443e7634a-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Acquiring lock "cinder-f15f7768-ed48-430f-94bd-577890d64ede-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Lock "cinder-f15f7768-ed48-430f-94bd-577890d64ede-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Acquiring lock "cinder-quobyte-f15f7768-ed48-430f-94bd-577890d64ede" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:24:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Lock "cinder-quobyte-f15f7768-ed48-430f-94bd-577890d64ede" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:24:57 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb0a50-fca5-4547-a164-bacf1897cde0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:24:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:57 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede Nov 05 22:24:57 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:58 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:58 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede Nov 05 22:24:58 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:58 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f15f7768-ed48-430f-94bd-577890d64ede" returned: 0 in 0.271s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Lock "cinder-quobyte-f15f7768-ed48-430f-94bd-577890d64ede" released by "delete_volume" :: held 0.785s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Created reservations ['86794a94-59f3-4aff-afb7-f4a984290fce', 'd7e3ecf6-024e-4a5d-b33a-e8db9196e9a5', '79c5befc-e350-4526-9c11-d922cfea1b91', '07b11559-8d9d-4013-8bd7-caba944a7beb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:24:58 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:24:58 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:24:58 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.268s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:24:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Deleted volume successfully. Nov 05 22:24:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f64a6634-71f3-4fcb-9b4a-a3b68ee0385f tempest-VolumesMetadataTest-1349386570 None] Lock "cinder-f15f7768-ed48-430f-94bd-577890d64ede-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:24:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-3766cd20-659e-4e92-9e3f-5d5c9463ec1b req-abcfafe9-d643-48d6-b72d-abda7161b14f tempest-TestInstancesWithCinderVolumes-741687458 None] Terminate volume connection completed successfully. Nov 05 22:24:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-3766cd20-659e-4e92-9e3f-5d5c9463ec1b req-abcfafe9-d643-48d6-b72d-abda7161b14f tempest-TestInstancesWithCinderVolumes-741687458 None] Deleting attachment 8dfb8449-d386-4f38-b703-b91aa979ac59. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:25:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "cinder-b3213e9d-30c8-4a4b-89e4-c150a99f6c80-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-b3213e9d-30c8-4a4b-89e4-c150a99f6c80-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "cinder-quobyte-b3213e9d-30c8-4a4b-89e4-c150a99f6c80" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-quobyte-b3213e9d-30c8-4a4b-89e4-c150a99f6c80" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7b151f-0112-49a2-abe5-318642c3e8a0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:00 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 Nov 05 22:25:00 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:01 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80" returned: 0 in 0.418s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:01 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80 Nov 05 22:25:01 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:01 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b3213e9d-30c8-4a4b-89e4-c150a99f6c80" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-quobyte-b3213e9d-30c8-4a4b-89e4-c150a99f6c80" released by "delete_volume" :: held 0.793s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:01 devstack cinder-volume[87085]: WARNING cinder.quota [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635296506-495596180 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635296506-495596180, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:25:01 devstack cinder-volume[87085]: WARNING cinder.quota [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635296506-495596180 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635296506-495596180, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Created reservations ['af43e229-7487-464b-bb08-b1ceb87ec474', '64333270-f77c-4af8-a17a-769f66574010', '5b69c862-3849-46f5-995f-2a3a7509a674', '4a303db4-2300-4589-82a9-be4bd16af7d7'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:01 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:01 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:02 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.352s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:02 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Deleted volume successfully. Nov 05 22:25:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f53ba3b2-8dcc-4c0a-aeba-0179cef26f05 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-b3213e9d-30c8-4a4b-89e4-c150a99f6c80-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Flow 'volume_create_manager' (215efbcc-9772-4eec-b1ec-70bf7d4ce5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d803396d-584b-4515-8ab5-f9e4d53910c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d803396d-584b-4515-8ab5-f9e4d53910c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2105882639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8a27f7-415f-4ef5-a574-202820ba361d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f6af42aa744826b8fd827b46fc6dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:03Z,use_quota=True,user_id='8ccba94ee789433ea1a60e0a7f40f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04671f-f780-49e4-85d2-2937fe541a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04671f-f780-49e4-85d2-2937fe541a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c263a445-1297-4fc6-b0da-123aaf5b7582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c263a445-1297-4fc6-b0da-123aaf5b7582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8a27f7-415f-4ef5-a574-202820ba361d', 'volume_name': 'volume-cb8a27f7-415f-4ef5-a574-202820ba361d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a004f7a-44a4-4d73-ad6e-458f61adfcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a004f7a-44a4-4d73-ad6e-458f61adfcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6341c6-fb4e-446a-a1af-f26e9fb0bb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:03 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Volume cb8a27f7-415f-4ef5-a574-202820ba361d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8a27f7-415f-4ef5-a574-202820ba361d', 'volume_size': 1} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2105882639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8a27f7-415f-4ef5-a574-202820ba361d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f6af42aa744826b8fd827b46fc6dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:03Z,use_quota=True,user_id='8ccba94ee789433ea1a60e0a7f40f009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Creating volume cb8a27f7-415f-4ef5-a574-202820ba361d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:03 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:25:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:03 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d 1073741824 Nov 05 22:25:03 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:04 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d 1073741824" returned: 0 in 0.725s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:04 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d Nov 05 22:25:04 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:04 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d" returned: 0 in 0.753s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6341c6-fb4e-446a-a1af-f26e9fb0bb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8a27f7-415f-4ef5-a574-202820ba361d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9506961e-ee5e-44fb-834b-b380d4cec532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Volume volume-cb8a27f7-415f-4ef5-a574-202820ba361d (cb8a27f7-415f-4ef5-a574-202820ba361d): created successfully Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9506961e-ee5e-44fb-834b-b380d4cec532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Flow 'volume_create_manager' (215efbcc-9772-4eec-b1ec-70bf7d4ce5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:05 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c6b18bd2-9f43-4c86-8e35-898afbb3ba23 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Created volume successfully. Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Flow 'volume_create_manager' (22a15f4c-a8cf-4634-ab16-94557c529515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8e5e88-9450-41e5-91da-2c0f56ba6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8e5e88-9450-41e5-91da-2c0f56ba6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1836459986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa581e44-6fff-44cf-a296-273fe13ce60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf50f2978b2f414caf006e5a9b99121c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:06Z,use_quota=True,user_id='a694459790884c6e938ee22f83b7d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14706a91-a771-4fc8-9b5e-593c8f838d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14706a91-a771-4fc8-9b5e-593c8f838d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cc5a0c-f748-4abd-973a-6a2beb6db878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cc5a0c-f748-4abd-973a-6a2beb6db878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa581e44-6fff-44cf-a296-273fe13ce60d', 'volume_name': 'volume-aa581e44-6fff-44cf-a296-273fe13ce60d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5f350a-9fcc-4f9f-8c07-349f343f3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5f350a-9fcc-4f9f-8c07-349f343f3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e30423-2e71-4825-a4b9-ca60eef9905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Volume aa581e44-6fff-44cf-a296-273fe13ce60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa581e44-6fff-44cf-a296-273fe13ce60d', 'volume_size': 1} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1836459986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa581e44-6fff-44cf-a296-273fe13ce60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf50f2978b2f414caf006e5a9b99121c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:06Z,use_quota=True,user_id='a694459790884c6e938ee22f83b7d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Creating volume aa581e44-6fff-44cf-a296-273fe13ce60d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:05 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:25:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:05 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d 1073741824 Nov 05 22:25:05 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-dcc164dc-ec88-4451-95e5-0d5dd645c556 req-d3ee79d9-34b7-402a-bccb-79ea84a5da68 tempest-TestInstancesWithCinderVolumes-741687458 None] Terminate volume connection completed successfully. Nov 05 22:25:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-dcc164dc-ec88-4451-95e5-0d5dd645c556 req-d3ee79d9-34b7-402a-bccb-79ea84a5da68 tempest-TestInstancesWithCinderVolumes-741687458 None] Deleting attachment bdb48c17-3caa-46cd-8e1a-6e47ab85d18e. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:25:06 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d 1073741824" returned: 0 in 0.774s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:06 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d Nov 05 22:25:06 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-4cfa3c21-a4e2-4953-aa0d-8cc5d5d9fdc0 req-a31575c2-5b0b-4361-82a4-abf3f24895c7 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:07 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-4cfa3c21-a4e2-4953-aa0d-8cc5d5d9fdc0 req-a31575c2-5b0b-4361-82a4-abf3f24895c7 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.143s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e30423-2e71-4825-a4b9-ca60eef9905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa581e44-6fff-44cf-a296-273fe13ce60d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b03dbb-5fe8-4b6f-9db9-3fb8f0aa288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-4cfa3c21-a4e2-4953-aa0d-8cc5d5d9fdc0 req-a31575c2-5b0b-4361-82a4-abf3f24895c7 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:07 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Volume volume-aa581e44-6fff-44cf-a296-273fe13ce60d (aa581e44-6fff-44cf-a296-273fe13ce60d): created successfully Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b03dbb-5fe8-4b6f-9db9-3fb8f0aa288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Flow 'volume_create_manager' (22a15f4c-a8cf-4634-ab16-94557c529515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d02d917a-dd4d-439e-bbe2-6c056dab2924 tempest-VolumesTransfersV355Test-313717744 None] Created volume successfully. Nov 05 22:25:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-4cfa3c21-a4e2-4953-aa0d-8cc5d5d9fdc0 req-a31575c2-5b0b-4361-82a4-abf3f24895c7 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-cb8a27f7-415f-4ef5-a574-202820ba361d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb44202a-e8b2-4cff-963a-8b5f19ffd917', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:25:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-4cfa3c21-a4e2-4953-aa0d-8cc5d5d9fdc0 req-a31575c2-5b0b-4361-82a4-abf3f24895c7 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] attachment_update completed successfully. Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "cinder-7d807242-fb6b-4119-98e9-7078ae15f6ab-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-7d807242-fb6b-4119-98e9-7078ae15f6ab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "cinder-quobyte-7d807242-fb6b-4119-98e9-7078ae15f6ab" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-quobyte-7d807242-fb6b-4119-98e9-7078ae15f6ab" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41004bb-bcd5-466d-bbd9-b0a25bdf906e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:08 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab Nov 05 22:25:08 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-738c2b35-d10c-47ba-aed8-d8cce9c94a49 tempest-VolumesTransfersV355Test-1213252288 None] Transfer volume completed successfully. Nov 05 22:25:08 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab" returned: 0 in 0.419s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:08 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab Nov 05 22:25:08 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:09 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Acquiring lock "cinder-aa581e44-6fff-44cf-a296-273fe13ce60d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7d807242-fb6b-4119-98e9-7078ae15f6ab" returned: 0 in 0.291s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-aa581e44-6fff-44cf-a296-273fe13ce60d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-quobyte-7d807242-fb6b-4119-98e9-7078ae15f6ab" released by "delete_volume" :: held 0.787s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Acquiring lock "cinder-quobyte-aa581e44-6fff-44cf-a296-273fe13ce60d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:09 devstack cinder-volume[87085]: WARNING cinder.quota [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1175240489-872145154 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1175240489-872145154, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:25:09 devstack cinder-volume[87085]: WARNING cinder.quota [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1175240489-872145154 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1175240489-872145154, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-quobyte-aa581e44-6fff-44cf-a296-273fe13ce60d" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Created reservations ['b763623a-dc2d-44c9-8b73-e17b615bb1b0', '74bfc361-bb07-4374-a7b6-8449e21cd5c4', 'ae278b12-3994-44bb-aa33-130eab273fd0', 'fa4ee2ba-23dd-4d32-b382-be7d72615a3b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[953da97d-25e9-477b-89b6-8a9c6cfaff3e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:09 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:09 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:09 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d Nov 05 22:25:09 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:09 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.372s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:09 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Deleted volume successfully. Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8764ec83-2712-4431-8262-87ca2939b115 tempest-TestInstancesWithCinderVolumes-741687458 None] Lock "cinder-7d807242-fb6b-4119-98e9-7078ae15f6ab-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:09 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d Nov 05 22:25:09 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:09 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa581e44-6fff-44cf-a296-273fe13ce60d" returned: 0 in 0.313s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-quobyte-aa581e44-6fff-44cf-a296-273fe13ce60d" released by "delete_volume" :: held 0.831s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Created reservations ['70fa66b4-9f5f-4ff3-92f3-7fc8b6426ec4', '30d8b07f-ae01-431e-857a-8969b3177e35', '32dd883b-7256-4028-9e94-f5319775bd06', '9cfac663-5862-41c0-bd22-0350fa5d7dee'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:10 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:10 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Flow 'volume_create_manager' (5dc342cd-fc52-4b03-b4a4-037bca7d6883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153f0a01-cec3-4d9b-885f-b1c08263cde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153f0a01-cec3-4d9b-885f-b1c08263cde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1427979880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19035d36-627c-469f-8553-151710cf7f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5119806ecb042268bf4053a59d63534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:10Z,use_quota=True,user_id='af3d393d7ca2437c8b18514217e8fb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf93bf6-e915-4bd5-80c2-ce2e4a3835d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf93bf6-e915-4bd5-80c2-ce2e4a3835d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34772bb-863b-467a-95a8-c388e71fe68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34772bb-863b-467a-95a8-c388e71fe68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19035d36-627c-469f-8553-151710cf7f50', 'volume_name': 'volume-19035d36-627c-469f-8553-151710cf7f50', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0fe2f6-d189-4cc9-81a2-19a9f30b8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0fe2f6-d189-4cc9-81a2-19a9f30b8731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4880a26-8b67-45c9-8b97-b95003b49dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Volume 19035d36-627c-469f-8553-151710cf7f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19035d36-627c-469f-8553-151710cf7f50', 'volume_size': 1} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1427979880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19035d36-627c-469f-8553-151710cf7f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5119806ecb042268bf4053a59d63534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:10Z,use_quota=True,user_id='af3d393d7ca2437c8b18514217e8fb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Creating volume 19035d36-627c-469f-8553-151710cf7f50 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:10 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:10 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 1073741824 Nov 05 22:25:10 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:10 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.362s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Deleted volume successfully. Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54c5bc66-7e7f-41e3-8043-6839ce8a02ad tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-aa581e44-6fff-44cf-a296-273fe13ce60d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-7d802261-796b-4186-af18-a625a992110d req-0bbb3cd8-a719-4aba-9ab5-06cb75c00569 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Terminate volume connection completed successfully. Nov 05 22:25:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-7d802261-796b-4186-af18-a625a992110d req-0bbb3cd8-a719-4aba-9ab5-06cb75c00569 tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Deleting attachment eb44202a-e8b2-4cff-963a-8b5f19ffd917. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Flow 'volume_create_manager' (a7c3cdf3-0ca7-4bfd-a8d9-43d2c4a21b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce37a8e-078b-47db-b141-1b26055f3f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:11 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce37a8e-078b-47db-b141-1b26055f3f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059316058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf50f2978b2f414caf006e5a9b99121c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:11Z,use_quota=True,user_id='a694459790884c6e938ee22f83b7d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9433a0fc-eea3-43f6-b8ea-82eff7c763e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9433a0fc-eea3-43f6-b8ea-82eff7c763e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcad3608-cce8-41e8-b4a9-41931b75e86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcad3608-cce8-41e8-b4a9-41931b75e86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a', 'volume_name': 'volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e925e6-20f2-43c0-8804-5c222b894e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e925e6-20f2-43c0-8804-5c222b894e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2682acb-843a-46aa-ba41-3a4e3e037767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Volume 9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a', 'volume_size': 1} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 1073741824" returned: 0 in 0.792s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:11 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 Nov 05 22:25:11 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:11 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50" returned: 0 in 0.263s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.299s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1059316058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf50f2978b2f414caf006e5a9b99121c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:11Z,use_quota=True,user_id='a694459790884c6e938ee22f83b7d075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Creating volume 9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:11 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:11 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a 1073741824 Nov 05 22:25:11 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4880a26-8b67-45c9-8b97-b95003b49dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19035d36-627c-469f-8553-151710cf7f50', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df89bf6-9ccd-4abd-adb5-876bafeed811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Acquiring lock "cinder-cb8a27f7-415f-4ef5-a574-202820ba361d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Volume volume-19035d36-627c-469f-8553-151710cf7f50 (19035d36-627c-469f-8553-151710cf7f50): created successfully Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df89bf6-9ccd-4abd-adb5-876bafeed811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Flow 'volume_create_manager' (5dc342cd-fc52-4b03-b4a4-037bca7d6883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "cinder-cb8a27f7-415f-4ef5-a574-202820ba361d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d77b3e76-cdba-4695-be15-7f263f6e4ecc tempest-AttachVolumeNegativeTest-1709425686 None] Created volume successfully. Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Acquiring lock "cinder-quobyte-cb8a27f7-415f-4ef5-a574-202820ba361d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "cinder-quobyte-cb8a27f7-415f-4ef5-a574-202820ba361d" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[03073fbb-a7ba-4930-b8b2-dcc20b631f8b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:11 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d Nov 05 22:25:11 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:12 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a 1073741824" returned: 0 in 0.493s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:12 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a Nov 05 22:25:12 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:12 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d" returned: 0 in 0.423s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:12 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d Nov 05 22:25:12 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:12 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a" returned: 0 in 0.300s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2682acb-843a-46aa-ba41-3a4e3e037767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24e8454-280d-4788-b489-83d956f761b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Volume volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a (9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a): created successfully Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24e8454-280d-4788-b489-83d956f761b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Flow 'volume_create_manager' (a7c3cdf3-0ca7-4bfd-a8d9-43d2c4a21b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:12 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-812807b8-13a4-4c82-b7fc-06801107cba9 tempest-VolumesTransfersV355Test-313717744 None] Created volume successfully. Nov 05 22:25:12 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cb8a27f7-415f-4ef5-a574-202820ba361d" returned: 0 in 0.352s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "cinder-quobyte-cb8a27f7-415f-4ef5-a574-202820ba361d" released by "delete_volume" :: held 0.822s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Created reservations ['96dadcad-2594-4f8a-8f67-0e1ff07b6fe1', '58f23109-72a3-444e-8773-c295fae134c1', 'ab821d2f-7962-4b31-aff3-dbb05ab2530f', '0a6169ef-f220-4335-a994-cd91cfb3317d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:12 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:12 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:13 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.390s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Deleted volume successfully. Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-04e7d294-f00c-4eaa-ba6d-087f207d0fcd tempest-TestServerVolumeAttachScenarioOldVersion-352564885 None] Lock "cinder-cb8a27f7-415f-4ef5-a574-202820ba361d-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b1bebef2-3777-4dd1-ab6e-7314b234d3d8 req-4a9f4232-d639-44b4-8921-844116907b55 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b1bebef2-3777-4dd1-ab6e-7314b234d3d8 req-4a9f4232-d639-44b4-8921-844116907b55 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-b1bebef2-3777-4dd1-ab6e-7314b234d3d8 req-4a9f4232-d639-44b4-8921-844116907b55 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-b1bebef2-3777-4dd1-ab6e-7314b234d3d8 req-4a9f4232-d639-44b4-8921-844116907b55 tempest-AttachVolumeNegativeTest-1709425686 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-19035d36-627c-469f-8553-151710cf7f50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '436b4497-122c-4c1a-9c0f-6c73b65b1fba', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Acquiring lock "cinder-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Acquiring lock "cinder-quobyte-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-b1bebef2-3777-4dd1-ab6e-7314b234d3d8 req-4a9f4232-d639-44b4-8921-844116907b55 tempest-AttachVolumeNegativeTest-1709425686 None] attachment_update completed successfully. Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-quobyte-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7160d9b4-4a76-4275-b561-f8b9d49331e8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:14 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a Nov 05 22:25:14 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:14 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a" returned: 0 in 0.563s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:14 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a Nov 05 22:25:14 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:15 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a" returned: 0 in 0.479s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-quobyte-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a" released by "delete_volume" :: held 1.101s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Created reservations ['5441283e-e364-4a23-a975-1db06c0b2ae1', '775e563b-7139-4aaa-b2f5-e763e408fad6', '8c8540d5-aa05-4882-90e7-f06c98867c83', '638f3805-06e5-4f13-aa6b-f8df72627a5a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:15 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:15 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:15 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.310s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Deleted volume successfully. Nov 05 22:25:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-abf3b8d1-d289-40e8-8905-c8bae9deaee6 tempest-VolumesTransfersV355Test-424626376 None] Lock "cinder-9c64ee41-254d-4ebe-85b6-5bf21bdfcc5a-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-7d09e294-b79a-4c74-b5e0-c181681f01a0 req-1ecba018-f885-47d2-86fc-703f2af191d9 tempest-AttachVolumeNegativeTest-1709425686 None] Terminate volume connection completed successfully. Nov 05 22:25:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-7d09e294-b79a-4c74-b5e0-c181681f01a0 req-1ecba018-f885-47d2-86fc-703f2af191d9 tempest-AttachVolumeNegativeTest-1709425686 None] Deleting attachment 436b4497-122c-4c1a-9c0f-6c73b65b1fba. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "cinder-19035d36-627c-469f-8553-151710cf7f50-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-19035d36-627c-469f-8553-151710cf7f50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "cinder-quobyte-19035d36-627c-469f-8553-151710cf7f50" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-quobyte-19035d36-627c-469f-8553-151710cf7f50" acquired by "delete_volume" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84cde1-f4b1-4e38-af0f-7437249176a0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:25 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 Nov 05 22:25:25 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:25 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50" returned: 0 in 0.467s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:25 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50 Nov 05 22:25:25 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:25 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-19035d36-627c-469f-8553-151710cf7f50" returned: 0 in 0.329s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-quobyte-19035d36-627c-469f-8553-151710cf7f50" released by "delete_volume" :: held 0.861s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Created reservations ['4434e20b-0b0a-45a0-91cb-481c5dbbda3f', 'e3ac6435-8e36-4fc7-8be8-9694cf98faad', 'b950302e-e93c-4aff-8391-46da4b7b0e63', '17ed31a7-6f78-46ba-8f8a-c84c6e3d935b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:26 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:26 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "cinder-36708096-c8bc-4c60-9db7-e7f95dbac21a-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-36708096-c8bc-4c60-9db7-e7f95dbac21a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "cinder-quobyte-36708096-c8bc-4c60-9db7-e7f95dbac21a" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-quobyte-36708096-c8bc-4c60-9db7-e7f95dbac21a" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:26 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c44378-5200-4262-8179-1661c4fe6c63]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.425s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Deleted volume successfully. Nov 05 22:25:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-512fc067-398d-4398-93d3-4b10188dd7bb tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-19035d36-627c-469f-8553-151710cf7f50-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:26 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a Nov 05 22:25:26 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:27 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a" returned: 0 in 0.537s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:27 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a Nov 05 22:25:27 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:27 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36708096-c8bc-4c60-9db7-e7f95dbac21a" returned: 0 in 0.348s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-quobyte-36708096-c8bc-4c60-9db7-e7f95dbac21a" released by "delete_volume" :: held 0.952s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Created reservations ['dbb84450-af64-44bf-9101-1963ddb4b63e', '82254a37-c4d7-4b28-a958-b091fb103633', '6f94842f-99cf-4e8c-b831-4dd6f387dea3', '118d3310-4c1b-42ff-a021-91e9623decac'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:27 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:27 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:28 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:28 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Deleted volume successfully. Nov 05 22:25:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-783422c5-1a2d-4669-821c-b0c50e6d3e80 tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-36708096-c8bc-4c60-9db7-e7f95dbac21a-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "cinder-5e0eb6f3-e621-4834-91a8-c68a00cab6e1-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-5e0eb6f3-e621-4834-91a8-c68a00cab6e1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "cinder-quobyte-5e0eb6f3-e621-4834-91a8-c68a00cab6e1" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-quobyte-5e0eb6f3-e621-4834-91a8-c68a00cab6e1" acquired by "delete_volume" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a44c89c-f824-4c07-9623-b1fd16b6aeb0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:29 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 Nov 05 22:25:29 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:29 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1" returned: 0 in 0.545s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:29 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1 Nov 05 22:25:29 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:29 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e0eb6f3-e621-4834-91a8-c68a00cab6e1" returned: 0 in 0.370s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-quobyte-5e0eb6f3-e621-4834-91a8-c68a00cab6e1" released by "delete_volume" :: held 0.980s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Created reservations ['7b10615e-c7e4-4e19-8fe2-f2b73bfafb0c', 'a2da22ea-896f-46e8-9885-a0fdade811ed', '637de0aa-435c-4544-8faf-a7c3edffd706', 'c56c5a23-d9d7-4a30-b07c-6d729f9442a2'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:30 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:30 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:30 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:30 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Deleted volume successfully. Nov 05 22:25:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3eaa9e74-28a7-481c-a016-2774bfaa616c tempest-AttachVolumeNegativeTest-1709425686 None] Lock "cinder-5e0eb6f3-e621-4834-91a8-c68a00cab6e1-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Flow 'volume_create_manager' (19ae3ef2-ee84-4e9f-bdff-b0ef2de7fe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3248ef00-fe52-4db6-b854-35a6b39d2845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3248ef00-fe52-4db6-b854-35a6b39d2845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-413015736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1371e90-cef7-44e2-863c-342ee6ed18c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f76c2444054e32a9c44341ab72d7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:31Z,use_quota=True,user_id='9eaede41de0b449f9cdbbea10a7d16a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf0898b-4e3f-4d39-9832-f46c7a19f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf0898b-4e3f-4d39-9832-f46c7a19f363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891a7960-ea68-41fd-80ff-961c4b46f62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891a7960-ea68-41fd-80ff-961c4b46f62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1371e90-cef7-44e2-863c-342ee6ed18c4', 'volume_name': 'volume-f1371e90-cef7-44e2-863c-342ee6ed18c4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5ea0ad-5e1a-4723-b361-35e79527274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5ea0ad-5e1a-4723-b361-35e79527274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8650b05f-9098-415d-b96c-8fb5c1916016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Volume f1371e90-cef7-44e2-863c-342ee6ed18c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1371e90-cef7-44e2-863c-342ee6ed18c4', 'volume_size': 1} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-413015736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1371e90-cef7-44e2-863c-342ee6ed18c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f76c2444054e32a9c44341ab72d7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:31Z,use_quota=True,user_id='9eaede41de0b449f9cdbbea10a7d16a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Creating volume f1371e90-cef7-44e2-863c-342ee6ed18c4 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:31 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:25:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:31 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 1073741824 Nov 05 22:25:31 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:32 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 1073741824" returned: 0 in 0.568s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:32 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 Nov 05 22:25:32 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:32 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4" returned: 0 in 0.547s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8650b05f-9098-415d-b96c-8fb5c1916016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1371e90-cef7-44e2-863c-342ee6ed18c4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7775c7f9-dc55-4ad7-b8c5-cdcb3364c156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Volume volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 (f1371e90-cef7-44e2-863c-342ee6ed18c4): created successfully Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7775c7f9-dc55-4ad7-b8c5-cdcb3364c156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Flow 'volume_create_manager' (19ae3ef2-ee84-4e9f-bdff-b0ef2de7fe0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-790c4fae-2545-47d1-af51-fbaacd2cd4bc tempest-VolumesTransfersV357Test-497032947 None] Created volume successfully. Nov 05 22:25:34 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cbcf9a5f-82cb-4f38-879c-c61bdfdf1f61 tempest-VolumesTransfersV357Test-1180860135 None] Transfer volume completed successfully. Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Acquiring lock "cinder-f1371e90-cef7-44e2-863c-342ee6ed18c4-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-f1371e90-cef7-44e2-863c-342ee6ed18c4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Acquiring lock "cinder-quobyte-f1371e90-cef7-44e2-863c-342ee6ed18c4" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-quobyte-f1371e90-cef7-44e2-863c-342ee6ed18c4" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b477241d-94c2-49ef-ab5f-64ca9d47829c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:35 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 Nov 05 22:25:35 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:35 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4" returned: 0 in 0.362s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:35 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4 Nov 05 22:25:35 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:36 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1371e90-cef7-44e2-863c-342ee6ed18c4" returned: 0 in 0.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-quobyte-f1371e90-cef7-44e2-863c-342ee6ed18c4" released by "delete_volume" :: held 0.670s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Created reservations ['9cf2071a-8a9d-4b80-b145-9e0806148bd3', '23c163bd-8480-43df-8468-39a3105b15dc', '7323a931-cf23-46ea-8381-9e33a57805e8', '1c52497e-5666-4d09-954b-0a16646f739a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:36 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:36 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:36 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.473s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Deleted volume successfully. Nov 05 22:25:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-12ad717c-a547-423c-a0b5-4ba60fa775b1 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-f1371e90-cef7-44e2-863c-342ee6ed18c4-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Flow 'volume_create_manager' (9ce83df3-ab23-473b-ac32-b9c14609a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ab7fb7-f801-42b9-9c0c-1326dfbb925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ab7fb7-f801-42b9-9c0c-1326dfbb925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-865993057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd468676-feea-4429-9bb0-d9f32578e01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f76c2444054e32a9c44341ab72d7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:37Z,use_quota=True,user_id='9eaede41de0b449f9cdbbea10a7d16a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528be1d5-0231-451a-aff1-0a754f4e5b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528be1d5-0231-451a-aff1-0a754f4e5b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e524a996-aae3-40e6-8e07-06d617be77c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e524a996-aae3-40e6-8e07-06d617be77c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd468676-feea-4429-9bb0-d9f32578e01b', 'volume_name': 'volume-bd468676-feea-4429-9bb0-d9f32578e01b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ab6806-5268-4e31-8ed1-59d2b0c7a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ab6806-5268-4e31-8ed1-59d2b0c7a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852134bc-f405-4f05-97b7-fc4ac8a66092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Volume bd468676-feea-4429-9bb0-d9f32578e01b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd468676-feea-4429-9bb0-d9f32578e01b', 'volume_size': 1} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-865993057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd468676-feea-4429-9bb0-d9f32578e01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f76c2444054e32a9c44341ab72d7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:25:37Z,use_quota=True,user_id='9eaede41de0b449f9cdbbea10a7d16a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Creating volume bd468676-feea-4429-9bb0-d9f32578e01b {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:25:37 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:25:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:37 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b 1073741824 Nov 05 22:25:37 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:38 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b 1073741824" returned: 0 in 0.674s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=95,cinder:UPDATE=121,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:38 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b Nov 05 22:25:38 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:38 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b" returned: 0 in 0.378s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852134bc-f405-4f05-97b7-fc4ac8a66092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd468676-feea-4429-9bb0-d9f32578e01b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6937e0-76ca-472b-bf75-ae3c4a2b00e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:25:38 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Volume volume-bd468676-feea-4429-9bb0-d9f32578e01b (bd468676-feea-4429-9bb0-d9f32578e01b): created successfully Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6937e0-76ca-472b-bf75-ae3c4a2b00e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Flow 'volume_create_manager' (9ce83df3-ab23-473b-ac32-b9c14609a28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:25:38 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=129,cinder:SELECT=121,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:25:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-51dd337e-ebe9-43e8-961d-8eb91b69eacf tempest-VolumesTransfersV357Test-497032947 None] Created volume successfully. Nov 05 22:25:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Acquiring lock "cinder-bd468676-feea-4429-9bb0-d9f32578e01b-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-bd468676-feea-4429-9bb0-d9f32578e01b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Acquiring lock "cinder-quobyte-bd468676-feea-4429-9bb0-d9f32578e01b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-quobyte-bd468676-feea-4429-9bb0-d9f32578e01b" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4d884-60b2-4dcd-a3af-fa891acaaea4]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:40 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b Nov 05 22:25:40 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:40 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:40 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:40 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b" returned: 0 in 0.564s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:40 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.383s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:25:40 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b Nov 05 22:25:40 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:40 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bd468676-feea-4429-9bb0-d9f32578e01b" returned: 0 in 0.312s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-quobyte-bd468676-feea-4429-9bb0-d9f32578e01b" released by "delete_volume" :: held 0.941s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Created reservations ['a3c4ba10-db2c-41c5-af82-973470914d08', 'a2576594-3556-41b4-b82b-afac8cbc40a9', 'c12f1a08-fb23-4116-b027-0fab71f46ef6', 'b8a46810-2355-47c3-bc67-8650861f9924'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:25:41 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:25:41 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:25:41 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.302s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:25:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Deleted volume successfully. Nov 05 22:25:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7f571c46-4aae-4382-82a7-c18879ed4733 tempest-VolumesTransfersV357Test-1253053371 None] Lock "cinder-bd468676-feea-4429-9bb0-d9f32578e01b-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:25:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:25:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=11,cinder:DELETE=2,cinder:SELECT=4,cinder:INSERT=3 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (072e7d3c-3578-4d7c-aa2a-89e89636b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc3ad38-740c-49c2-a15a-66483bb877a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc3ad38-740c-49c2-a15a-66483bb877a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1779630508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548feb36-a223-428c-8cbc-5b97114d9eee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:00Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541472dd-2e81-4345-8dea-11064de140eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541472dd-2e81-4345-8dea-11064de140eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fb44a5-5d15-4895-b82e-a7f5b2610f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0fb44a5-5d15-4895-b82e-a7f5b2610f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548feb36-a223-428c-8cbc-5b97114d9eee', 'volume_name': 'volume-548feb36-a223-428c-8cbc-5b97114d9eee', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c2ca03-ba79-4cc2-96a9-13c17348fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c2ca03-ba79-4cc2-96a9-13c17348fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0c184e-c10a-4703-be09-8c7bdf6e5bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:00 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Volume 548feb36-a223-428c-8cbc-5b97114d9eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548feb36-a223-428c-8cbc-5b97114d9eee', 'volume_size': 1} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1779630508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548feb36-a223-428c-8cbc-5b97114d9eee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:00Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Creating volume 548feb36-a223-428c-8cbc-5b97114d9eee {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:00 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:00 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee 1073741824 Nov 05 22:26:00 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:00 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee 1073741824" returned: 0 in 0.679s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:01 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee Nov 05 22:26:01 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:01 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee" returned: 0 in 0.313s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0c184e-c10a-4703-be09-8c7bdf6e5bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548feb36-a223-428c-8cbc-5b97114d9eee', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db63de6-cd7c-4163-b7cc-e3cbb0265cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:01 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Volume volume-548feb36-a223-428c-8cbc-5b97114d9eee (548feb36-a223-428c-8cbc-5b97114d9eee): created successfully Nov 05 22:26:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db63de6-cd7c-4163-b7cc-e3cbb0265cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (072e7d3c-3578-4d7c-aa2a-89e89636b088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-da919a75-6868-4232-ac07-aafc1af744f4 tempest-VolumesGetTest-21270069 None] Created volume successfully. Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (84cd1710-bb0e-47bd-a061-b77c9e58ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55454e01-faef-460f-851b-0f906f5f497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55454e01-faef-460f-851b-0f906f5f497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-688116375',display_name='tempest-VolumesGetTest-Volume-1621656093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e452ec-72fc-4ab0-9c84-4b3ce7ddd855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:03Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11182e14-f617-4971-8ffb-8351d3a21673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11182e14-f617-4971-8ffb-8351d3a21673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af96114a-b866-4ce1-9026-b52de940594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af96114a-b866-4ce1-9026-b52de940594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e452ec-72fc-4ab0-9c84-4b3ce7ddd855', 'volume_name': 'volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603f48a3-ca5d-4ec8-8965-41597755f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603f48a3-ca5d-4ec8-8965-41597755f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70978568-504b-47be-bf58-527c136faeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:03 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Volume 36e452ec-72fc-4ab0-9c84-4b3ce7ddd855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855', 'volume_size': 1} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-688116375',display_name='tempest-VolumesGetTest-Volume-1621656093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e452ec-72fc-4ab0-9c84-4b3ce7ddd855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:03Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Creating volume 36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:03 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:03 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 1073741824 Nov 05 22:26:03 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8703b6ef-98ad-4bb6-96d3-e655913d996b tempest-GroupsV320Test-1918361571 None] Group tempest-GroupsV320Test-Group-1172084268: creating Nov 05 22:26:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8703b6ef-98ad-4bb6-96d3-e655913d996b tempest-GroupsV320Test-1918361571 None] Group tempest-GroupsV320Test-Group-1172084268: created successfully Nov 05 22:26:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8703b6ef-98ad-4bb6-96d3-e655913d996b tempest-GroupsV320Test-1918361571 None] Create group completed successfully. Nov 05 22:26:04 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 1073741824" returned: 0 in 0.611s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:04 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 Nov 05 22:26:04 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:04 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855" returned: 0 in 0.338s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70978568-504b-47be-bf58-527c136faeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d49f9-b475-42e1-aa33-7a0923003a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:04 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Volume volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 (36e452ec-72fc-4ab0-9c84-4b3ce7ddd855): created successfully Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d49f9-b475-42e1-aa33-7a0923003a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (84cd1710-bb0e-47bd-a061-b77c9e58ff29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-aa53089e-82f0-4872-a693-3d1bd88d9bc0 tempest-VolumesGetTest-21270069 None] Created volume successfully. Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Created reservations ['04842e5d-c192-4183-9cd6-3dd610b5e1fb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:05 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:05 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Lock "cinder-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855" acquired by "delete_volume" :: waited 0.065s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:06 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d9df5a-e341-4a0d-a589-aad2c020fed3]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:06 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.453s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:06 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cfb54654-bba9-4299-b20a-1f8c92b8431e tempest-GroupsV320Test-1918361571 None] Delete group completed successfully. Nov 05 22:26:06 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 Nov 05 22:26:06 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:06 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855" returned: 0 in 0.465s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:06 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855 Nov 05 22:26:06 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:06 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855" released by "delete_volume" :: held 1.017s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Created reservations ['efa375f5-327e-4cb9-a95f-a98a6a14f9e6', 'df4e69b4-b38b-44db-937d-8e57120c915f', 'c0cef15c-4543-43b0-ae3b-0d79ff498818', '0d08cf63-c797-47e1-bd22-467056ad392c'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:07 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:07 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:07 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Deleted volume successfully. Nov 05 22:26:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9dba54b-ee0d-4c63-9dde-a0188fb969df tempest-VolumesGetTest-21270069 None] Lock "cinder-36e452ec-72fc-4ab0-9c84-4b3ce7ddd855-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-548feb36-a223-428c-8cbc-5b97114d9eee-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Lock "cinder-548feb36-a223-428c-8cbc-5b97114d9eee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-548feb36-a223-428c-8cbc-5b97114d9eee" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-548feb36-a223-428c-8cbc-5b97114d9eee" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:08 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c1d2c2-2283-4230-b0d6-7e1ed7383800]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:08 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee Nov 05 22:26:08 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:09 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee" returned: 0 in 0.556s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:09 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee Nov 05 22:26:09 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:09 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-548feb36-a223-428c-8cbc-5b97114d9eee" returned: 0 in 0.349s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-548feb36-a223-428c-8cbc-5b97114d9eee" released by "delete_volume" :: held 0.984s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Created reservations ['0ac1c2f9-e46a-4479-801b-a925f4b91c2f', 'aa28a3e2-c69b-4d69-92f4-3a66b7c66df3', '81954b52-477b-4a3a-83dc-35c50057144c', 'c4197207-ed69-4bb9-a2cf-49032a5815db'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:09 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:09 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:09 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.292s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Deleted volume successfully. Nov 05 22:26:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b011ab9-be99-42b7-80e5-e8e6c14cc7e4 tempest-VolumesGetTest-21270069 None] Lock "cinder-548feb36-a223-428c-8cbc-5b97114d9eee-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (3be1f118-4243-4a36-92d7-97630af6a30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc53ecdb-02ae-43bb-b4f2-d7b89ef23cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc53ecdb-02ae-43bb-b4f2-d7b89ef23cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1515430346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a5a6a6-9560-49be-9e70-a795cb7d95ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:11Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3bd913-3b68-4fe0-8503-844a4088a2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3bd913-3b68-4fe0-8503-844a4088a2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4792ce58-cdea-49fe-8f59-e1acc8686cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4792ce58-cdea-49fe-8f59-e1acc8686cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a5a6a6-9560-49be-9e70-a795cb7d95ae', 'volume_name': 'volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c1c996-f874-4295-89ef-89f62e112990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31c1c996-f874-4295-89ef-89f62e112990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5f9ef5-0905-480a-8d24-42af539b883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Volume d1a5a6a6-9560-49be-9e70-a795cb7d95ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae', 'volume_size': 1} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1515430346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a5a6a6-9560-49be-9e70-a795cb7d95ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:11Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Creating volume d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:11 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:11 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae 1073741824 Nov 05 22:26:11 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:12 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae 1073741824" returned: 0 in 0.571s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:12 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae Nov 05 22:26:12 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:12 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" returned: 0 in 0.328s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5f9ef5-0905-480a-8d24-42af539b883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef68a075-8f7e-4b5f-81b5-c6322e5f1a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Volume volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae (d1a5a6a6-9560-49be-9e70-a795cb7d95ae): created successfully Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef68a075-8f7e-4b5f-81b5-c6322e5f1a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (3be1f118-4243-4a36-92d7-97630af6a30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:12 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-445adee6-262b-4035-bbb0-13c1e1f9f8b3 tempest-VolumesGetTest-21270069 None] Created volume successfully. Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (a778f792-d467-4433-b76d-7dc611081958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80853317-6b60-474d-9029-aba66f0eb3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80853317-6b60-474d-9029-aba66f0eb3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1394206552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cec820e-6a20-442f-959c-bf4c4c2c5fb4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d1a5a6a6-9560-49be-9e70-a795cb7d95ae,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:15Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd3b4cc-7bf8-43e6-9421-643d6c07ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd3b4cc-7bf8-43e6-9421-643d6c07ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c64f72c-6c18-49f6-bbcd-7a57b15eb0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c64f72c-6c18-49f6-bbcd-7a57b15eb0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0cec820e-6a20-442f-959c-bf4c4c2c5fb4', 'volume_name': 'volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4', 'volume_size': 1, 'source_volid': 'd1a5a6a6-9560-49be-9e70-a795cb7d95ae', 'source_volstatus': 'available'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef2a1bb-1b3b-4043-901d-367a43a1e120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef2a1bb-1b3b-4043-901d-367a43a1e120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6876c4d-3016-4cfd-a12c-267fc84cdbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:14 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Volume 0cec820e-6a20-442f-959c-bf4c4c2c5fb4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4', 'volume_size': 1, 'source_volid': 'd1a5a6a6-9560-49be-9e70-a795cb7d95ae', 'source_volstatus': 'available'} Nov 05 22:26:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:15 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Cloning volume d1a5a6a6-9560-49be-9e70-a795cb7d95ae to volume 0cec820e-6a20-442f-959c-bf4c4c2c5fb4 Nov 05 22:26:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Creating offline snapshot 8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 of volume d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:26:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa0915-1b8a-46c8-86b3-ba5e426a7a21]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:15 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae Nov 05 22:26:15 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:15 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" returned: 0 in 0.723s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:15 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 1G Nov 05 22:26:15 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:16 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 1G" returned: 0 in 0.655s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:16 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 Nov 05 22:26:16 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:17 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" returned: 0 in 0.545s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:17 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 is being set with open permissions: ugo+rw Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:17 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 Nov 05 22:26:17 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:17 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" returned: 0 in 0.503s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:17 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.info Nov 05 22:26:17 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Flow 'volume_create_manager' (26488baf-31fb-4676-82d8-6d94dc2290cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fec2a70-5432-40dc-85a3-281c3691bc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fec2a70-5432-40dc-85a3-281c3691bc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-755527624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a0cfdb-7024-444d-abd3-63ee510f75e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3958f8cf04044cfc8c7861fce671a11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:18Z,use_quota=True,user_id='ac6d274ac6944fb6af32bcb2b85bf3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bbe93a-ec45-4211-ade3-e916c14845e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bbe93a-ec45-4211-ade3-e916c14845e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd9fdf8-fab2-4781-a281-55086119ccbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:17 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:26:18 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.info" returned: 0 in 0.527s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:18 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.info is being set with open permissions: ugo+rw Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:18 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.info Nov 05 22:26:18 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:18 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.info" returned: 0 in 0.370s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] snapshot: 8e4ac34c-b0c7-4446-8ac9-757f72fb69b6, volume: 0cec820e-6a20-442f-959c-bf4c4c2c5fb4, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0878ffb-ea47-4f07-880a-37680e316b6b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd9fdf8-fab2-4781-a281-55086119ccbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7a0cfdb-7024-444d-abd3-63ee510f75e3', 'volume_name': 'volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea067d9-b59e-4524-9f82-fe6b42ecae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea067d9-b59e-4524-9f82-fe6b42ecae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970c5cf1-8c97-485a-9c7c-9eaba47c4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:18 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Volume e7a0cfdb-7024-444d-abd3-63ee510f75e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:26:18 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Trying to clone e7a0cfdb-7024-444d-abd3-63ee510f75e3 from image 7f51a389-75a1-4170-8607-9bba700950bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:26:18 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 Nov 05 22:26:18 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Flow 'volume_create_manager' (7ce18049-8b62-410b-a788-949caf88e598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d40704-6b3f-40c6-a398-79d4de5952b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d40704-6b3f-40c6-a398-79d4de5952b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1642261546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b438278-2a30-4fda-beb9-69f6ef30efdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7826319e4c5a4faa86520a719b2eca10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:19Z,use_quota=True,user_id='dedcaed0dcef41fcbe3780e844722871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40438d27-cb8f-4583-a1f2-f0e2ce10f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40438d27-cb8f-4583-a1f2-f0e2ce10f181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443e64cc-8f84-4514-bd3c-b115a54930b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443e64cc-8f84-4514-bd3c-b115a54930b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b438278-2a30-4fda-beb9-69f6ef30efdd', 'volume_name': 'volume-6b438278-2a30-4fda-beb9-69f6ef30efdd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1cb859-c0bf-4c49-a1d8-9ba3f78bd899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1cb859-c0bf-4c49-a1d8-9ba3f78bd899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ca4dcb-eae3-412e-b93e-aee96fc2b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:19 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Volume 6b438278-2a30-4fda-beb9-69f6ef30efdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b438278-2a30-4fda-beb9-69f6ef30efdd', 'volume_size': 1} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:19 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" returned: 0 in 0.697s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b758a04-2a3d-4210-be32-001f4bbb9f84]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:26:19 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[23386651-936e-4dc8-a6a3-ce434e65f989]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:19 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae Nov 05 22:26:19 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:19 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD Nov 05 22:26:19 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:19 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" returned: 0 in 0.470s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:26:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:19 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 Nov 05 22:26:19 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:20 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:20 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc is fetched for user ac6d274ac6944fb6af32bcb2b85bf3ad. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:26:20 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d020b0-4fa1-47c2-ba46-ad26d9616112]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:20 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD Nov 05 22:26:20 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:20 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:28 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" returned: 0 in 9.010s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:28 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:26:28 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Converted 1024.00 MB image at 113.64 MB/s Nov 05 22:26:28 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 is being set with open permissions: ugo+rw Nov 05 22:26:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:28 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 Nov 05 22:26:28 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:29 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" returned: 0 in 0.264s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" released by "_copy_volume_from_snapshot" :: held 10.572s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Deleting offline snapshot 8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 of volume d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] snapshot_file for this snap is: volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b7b5b-21e4-48a5-b297-4dbd9069b333]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:29 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 Nov 05 22:26:29 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:29 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" returned: 0 in 0.413s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d7ba9e-833e-4685-9eb3-7fdb90c13051]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:29 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae Nov 05 22:26:29 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2,cinder:SELECT=30 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:26:30 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" returned: 0 in 0.567s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:30 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 Nov 05 22:26:30 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:30 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" returned: 0 in 0.363s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:30 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6 Nov 05 22:26:30 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:30 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae.8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" returned: 0 in 0.251s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-8e4ac34c-b0c7-4446-8ac9-757f72fb69b6" released by "_delete_snapshot" :: held 1.707s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.923s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.763s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1642261546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b438278-2a30-4fda-beb9-69f6ef30efdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7826319e4c5a4faa86520a719b2eca10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:19Z,use_quota=True,user_id='dedcaed0dcef41fcbe3780e844722871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Creating volume 6b438278-2a30-4fda-beb9-69f6ef30efdd {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:30 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6876c4d-3016-4cfd-a12c-267fc84cdbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4', 'volume_size': 1, 'source_volid': 'd1a5a6a6-9560-49be-9e70-a795cb7d95ae', 'source_volstatus': 'available'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:30 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd 1073741824 Nov 05 22:26:30 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0664c05c-7fe7-4e5a-af81-fa7c2813f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:30 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Volume volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 (0cec820e-6a20-442f-959c-bf4c4c2c5fb4): created successfully Nov 05 22:26:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0664c05c-7fe7-4e5a-af81-fa7c2813f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (a778f792-d467-4433-b76d-7dc611081958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9994f78a-be6f-4e50-9e85-c348d0fb1d32 tempest-VolumesGetTest-21270069 None] Created volume successfully. Nov 05 22:26:31 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd 1073741824" returned: 0 in 0.521s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:31 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd Nov 05 22:26:31 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:31 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd" returned: 0 in 0.269s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.228s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-755527624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a0cfdb-7024-444d-abd3-63ee510f75e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3958f8cf04044cfc8c7861fce671a11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:18Z,use_quota=True,user_id='ac6d274ac6944fb6af32bcb2b85bf3ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Creating volume e7a0cfdb-7024-444d-abd3-63ee510f75e3 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:31 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:31 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 1073741824 Nov 05 22:26:31 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ca4dcb-eae3-412e-b93e-aee96fc2b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b438278-2a30-4fda-beb9-69f6ef30efdd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b0216b-e3a4-4892-b07e-485d162308b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Volume volume-6b438278-2a30-4fda-beb9-69f6ef30efdd (6b438278-2a30-4fda-beb9-69f6ef30efdd): created successfully Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b0216b-e3a4-4892-b07e-485d162308b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Flow 'volume_create_manager' (7ce18049-8b62-410b-a788-949caf88e598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4729e645-32ab-491b-9dad-8062cfd5eaef tempest-TestMinimumBasicScenario-726444295 None] Created volume successfully. Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (25bb2114-14eb-48f9-8f0a-82be1c1c2f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7defc9-00dd-4153-a3e4-084019fd1982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7defc9-00dd-4153-a3e4-084019fd1982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915272955',display_name='tempest-VolumesGetTest-Volume-2016489146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e7a8bd-d701-43d6-8791-5e42d430de4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:32Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332d265a-fdc1-4ecc-b24b-78e73820145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332d265a-fdc1-4ecc-b24b-78e73820145a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3675a488-2c33-4563-9fa4-77a33db1f44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3675a488-2c33-4563-9fa4-77a33db1f44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e7a8bd-d701-43d6-8791-5e42d430de4c', 'volume_name': 'volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:32 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bd7e32-0f79-4555-95f5-8da848e64033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bd7e32-0f79-4555-95f5-8da848e64033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46edab9-2c1f-4999-8cc7-9482fb828314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Volume f5e7a8bd-d701-43d6-8791-5e42d430de4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c', 'volume_size': 1} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 1073741824" returned: 0 in 0.577s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:32 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 Nov 05 22:26:32 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:32 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3" returned: 0 in 0.282s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1915272955',display_name='tempest-VolumesGetTest-Volume-2016489146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e7a8bd-d701-43d6-8791-5e42d430de4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:32Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Creating volume f5e7a8bd-d701-43d6-8791-5e42d430de4c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:32 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:32 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c 1073741824 Nov 05 22:26:32 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Attempting download of 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume e7a0cfdb-7024-444d-abd3-63ee510f75e3. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4121b6d9-a717-43c9-ba56-add52f48b570]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_i9_mrvn5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:32 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_i9_mrvn5 Nov 05 22:26:32 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:33 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_i9_mrvn5" returned: 0 in 0.543s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_i9_mrvn5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:33 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c 1073741824" returned: 0 in 0.714s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:33 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c Nov 05 22:26:33 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:33 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_i9_mrvn5 Nov 05 22:26:33 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:33 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_i9_mrvn5" returned: 1 in 0.405s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_i9_mrvn5' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e6c626-6d30-4920-a73b-5bf4385947ed]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:33 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c" returned: 0 in 0.364s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46edab9-2c1f-4999-8cc7-9482fb828314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437ba3e6-e2bf-454a-a7b5-4b72df8a0b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:33 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Volume volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c (f5e7a8bd-d701-43d6-8791-5e42d430de4c): created successfully Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437ba3e6-e2bf-454a-a7b5-4b72df8a0b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (25bb2114-14eb-48f9-8f0a-82be1c1c2f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-dea81720-a974-4d7c-a058-a38a44bfdce6 tempest-VolumesGetTest-21270069 None] Created volume successfully. Nov 05 22:26:33 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD Nov 05 22:26:33 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-50699300-2db8-44c1-9590-25dd21f1c7b9 req-ee7e22dc-988d-4a33-8941-12f596369d6e tempest-TestMinimumBasicScenario-726444295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-50699300-2db8-44c1-9590-25dd21f1c7b9 req-ee7e22dc-988d-4a33-8941-12f596369d6e tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-50699300-2db8-44c1-9590-25dd21f1c7b9 req-ee7e22dc-988d-4a33-8941-12f596369d6e tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:34 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] 7f51a389-75a1-4170-8607-9bba700950bc was qcow2, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:34 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 Nov 05 22:26:34 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-50699300-2db8-44c1-9590-25dd21f1c7b9 req-ee7e22dc-988d-4a33-8941-12f596369d6e tempest-TestMinimumBasicScenario-726444295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-6b438278-2a30-4fda-beb9-69f6ef30efdd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7dfab7c-519e-450e-bfa8-786abaa0281a', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:26:34 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-50699300-2db8-44c1-9590-25dd21f1c7b9 req-ee7e22dc-988d-4a33-8941-12f596369d6e tempest-TestMinimumBasicScenario-726444295 None] attachment_update completed successfully. Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-f5e7a8bd-d701-43d6-8791-5e42d430de4c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Lock "cinder-f5e7a8bd-d701-43d6-8791-5e42d430de4c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Flow 'volume_create_manager' (974e57b3-657b-4e91-950c-f74e647dfb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6126a53-a489-4f6b-bd97-860d71a3f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6126a53-a489-4f6b-bd97-860d71a3f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-161958084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5358dce0-1bfe-4ccf-9bed-347bd53dfe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ed96a4e264e4b80e2bd2259b748e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:35Z,use_quota=True,user_id='97b432e9dc084ae9aa8e47e551e6d356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567ea7a9-2ddc-4832-88c5-997559ada85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567ea7a9-2ddc-4832-88c5-997559ada85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82235a5a-1536-49fd-b588-7e388ec8088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82235a5a-1536-49fd-b588-7e388ec8088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5358dce0-1bfe-4ccf-9bed-347bd53dfe8b', 'volume_name': 'volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28420bb8-5773-439c-8ab6-3e22aa643e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28420bb8-5773-439c-8ab6-3e22aa643e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9a3059-1ad7-41a2-b7dd-a0fbfd041bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Volume 5358dce0-1bfe-4ccf-9bed-347bd53dfe8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b', 'volume_size': 1} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-161958084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5358dce0-1bfe-4ccf-9bed-347bd53dfe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ed96a4e264e4b80e2bd2259b748e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:35Z,use_quota=True,user_id='97b432e9dc084ae9aa8e47e551e6d356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Creating volume 5358dce0-1bfe-4ccf-9bed-347bd53dfe8b {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:35 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-f5e7a8bd-d701-43d6-8791-5e42d430de4c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:35 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b 1073741824 Nov 05 22:26:35 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-f5e7a8bd-d701-43d6-8791-5e42d430de4c" acquired by "delete_volume" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e107840-54a6-4d32-b979-4bf50f4e1651]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:35 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c Nov 05 22:26:35 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:35 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c" returned: 0 in 0.590s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:35 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c Nov 05 22:26:35 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:36 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b 1073741824" returned: 0 in 0.824s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:36 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b Nov 05 22:26:36 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:36 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f5e7a8bd-d701-43d6-8791-5e42d430de4c" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-f5e7a8bd-d701-43d6-8791-5e42d430de4c" released by "delete_volume" :: held 1.121s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Created reservations ['83122e91-b710-4410-b1bb-130175b7915a', '7408b991-edcb-4738-a286-29b8bf1fb36a', '16626dec-1c1f-4c3f-9cc1-29fa97898506', 'f0213f33-0553-4252-8005-381ad75cc558'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:36 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b" returned: 0 in 0.444s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9a3059-1ad7-41a2-b7dd-a0fbfd041bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3338f11-533b-43d9-b043-e66cc51bbe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:36 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Volume volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b (5358dce0-1bfe-4ccf-9bed-347bd53dfe8b): created successfully Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3338f11-533b-43d9-b043-e66cc51bbe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:36 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:36 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Flow 'volume_create_manager' (974e57b3-657b-4e91-950c-f74e647dfb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1c22b6d2-4c12-4408-8a2a-47f6cca6f748 tempest-VolumeQuotasAdminTestJSON-977153145 None] Created volume successfully. Nov 05 22:26:37 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.378s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Deleted volume successfully. Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-96a3b5c4-4cfa-4a84-a450-7a512cf4bfef tempest-VolumesGetTest-21270069 None] Lock "cinder-f5e7a8bd-d701-43d6-8791-5e42d430de4c-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:37 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3" returned: 0 in 2.938s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_bv_0agmgdevstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:26:37 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Converted 112.00 MB image at 38.07 MB/s Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Acquiring lock "cinder-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:37 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 1G Nov 05 22:26:37 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "cinder-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Acquiring lock "cinder-quobyte-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "cinder-quobyte-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b" acquired by "delete_volume" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9206664e-2442-450a-899a-9ddd0b266390]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-0cec820e-6a20-442f-959c-bf4c4c2c5fb4-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Lock "cinder-0cec820e-6a20-442f-959c-bf4c4c2c5fb4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:37 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b Nov 05 22:26:37 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e5ca04-05bb-477a-a373-1a82423fa139]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:37 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 1G" returned: 0 in 0.526s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Downloaded image 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume e7a0cfdb-7024-444d-abd3-63ee510f75e3 successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:26:37 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 Nov 05 22:26:37 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc for user ac6d274ac6944fb6af32bcb2b85bf3ad is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Marking volume e7a0cfdb-7024-444d-abd3-63ee510f75e3 as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Copying metadata from image 7f51a389-75a1-4170-8607-9bba700950bc to e7a0cfdb-7024-444d-abd3-63ee510f75e3. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Creating volume glance metadata for volume e7a0cfdb-7024-444d-abd3-63ee510f75e3 backed by image 7f51a389-75a1-4170-8607-9bba700950bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970c5cf1-8c97-485a-9c7c-9eaba47c4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8529131-cecb-47f2-8efc-6877ebec586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:37 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b" returned: 0 in 0.492s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Volume volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 (e7a0cfdb-7024-444d-abd3-63ee510f75e3): created successfully Nov 05 22:26:37 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b Nov 05 22:26:37 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8529131-cecb-47f2-8efc-6877ebec586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Flow 'volume_create_manager' (26488baf-31fb-4676-82d8-6d94dc2290cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a88c9211-75f9-4849-bea9-05c9adfa3785 tempest-TestShelveInstance-1268324992 None] Created volume successfully. Nov 05 22:26:38 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" returned: 0 in 0.439s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:38 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4 Nov 05 22:26:38 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:38 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b" returned: 0 in 0.300s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "cinder-quobyte-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b" released by "delete_volume" :: held 0.864s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Created reservations ['f3cc5c9c-6475-4fa7-8e1c-7d75883368c2', 'c0f78430-65bc-4441-a7db-6b37773789b7', '795444a1-bfe9-4376-9558-44ffd2750662', '81fbaa91-10b7-4472-a23f-db57544ca15f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:38 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" returned: 0 in 0.283s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-0cec820e-6a20-442f-959c-bf4c4c2c5fb4" released by "delete_volume" :: held 0.792s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:38 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:38 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Created reservations ['a99bc344-b04b-4f4c-9641-7424fff7b952', '0f59b82e-d8e8-46c3-966d-1e831836c9ac', '718ce2c0-48ff-45f6-98ea-8558f2442421', 'fbaa3ea9-7f47-4ef5-ae91-cb5059ec9511'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:38 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:38 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:38 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.366s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Deleted volume successfully. Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-d1a5a6a6-9560-49be-9e70-a795cb7d95ae-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Lock "cinder-d1a5a6a6-9560-49be-9e70-a795cb7d95ae-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c632c4d0-e344-4641-b46c-a4cefab628ec tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "cinder-5358dce0-1bfe-4ccf-9bed-347bd53dfe8b-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3215281e-be16-48e3-901b-e776af875262]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:39 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.472s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Deleted volume successfully. Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b095f1dc-ad24-4fcb-9db1-06f2e55f6d55 tempest-VolumesGetTest-21270069 None] Lock "cinder-0cec820e-6a20-442f-959c-bf4c4c2c5fb4-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:39 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae Nov 05 22:26:39 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Flow 'volume_create_manager' (52e0eb08-7cb5-453a-bec0-9f7c5d5283e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a82d94-bf90-4e01-84a8-3a68dcdf45fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a82d94-bf90-4e01-84a8-3a68dcdf45fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-419830291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8c7505-e358-42fe-947e-b9805fe91686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ed96a4e264e4b80e2bd2259b748e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:39Z,use_quota=True,user_id='97b432e9dc084ae9aa8e47e551e6d356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3652a3a3-cb16-4875-90d5-bc9efcec2105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3652a3a3-cb16-4875-90d5-bc9efcec2105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e10eb02-2673-48b6-ba5e-6ca107a249f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e10eb02-2673-48b6-ba5e-6ca107a249f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be8c7505-e358-42fe-947e-b9805fe91686', 'volume_name': 'volume-be8c7505-e358-42fe-947e-b9805fe91686', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd56280-f07d-4482-ba29-857659cfa737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd56280-f07d-4482-ba29-857659cfa737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f024a6-b655-4ffd-aacc-17cca67b0483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:39 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Volume be8c7505-e358-42fe-947e-b9805fe91686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be8c7505-e358-42fe-947e-b9805fe91686', 'volume_size': 1} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-419830291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be8c7505-e358-42fe-947e-b9805fe91686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4ed96a4e264e4b80e2bd2259b748e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:39Z,use_quota=True,user_id='97b432e9dc084ae9aa8e47e551e6d356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Creating volume be8c7505-e358-42fe-947e-b9805fe91686 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:39 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:39 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 1073741824 Nov 05 22:26:39 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:39 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" returned: 0 in 0.464s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:39 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae Nov 05 22:26:39 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:39 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:39 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" returned: 0 in 0.354s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 1073741824" returned: 0 in 0.554s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-d1a5a6a6-9560-49be-9e70-a795cb7d95ae" released by "delete_volume" :: held 0.898s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:39 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 Nov 05 22:26:39 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Created reservations ['3b9b1cd6-5d9c-449e-a4b5-7a103aa9b192', 'b358466a-b049-467f-b471-d339154ab2f9', 'fd765b1e-107f-4e53-b96a-db7292b5ff2e', '84d4176b-f827-4bbb-a3c2-df34f45f858b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:40 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:40 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:40 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686" returned: 0 in 0.315s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f024a6-b655-4ffd-aacc-17cca67b0483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be8c7505-e358-42fe-947e-b9805fe91686', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44738c0e-8bdb-4fc6-930e-1e85181ff2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:40 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Volume volume-be8c7505-e358-42fe-947e-b9805fe91686 (be8c7505-e358-42fe-947e-b9805fe91686): created successfully Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44738c0e-8bdb-4fc6-930e-1e85181ff2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:40 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Flow 'volume_create_manager' (52e0eb08-7cb5-453a-bec0-9f7c5d5283e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:40 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-06b8e8ed-2d0c-4d3f-a8e0-2104115d286f tempest-VolumeQuotasAdminTestJSON-977153145 None] Created volume successfully. Nov 05 22:26:40 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.493s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Deleted volume successfully. Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9770042c-efae-4632-b9ba-0bd2dd2a16b9 tempest-VolumesGetTest-21270069 None] Lock "cinder-d1a5a6a6-9560-49be-9e70-a795cb7d95ae-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:40 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.506s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:26:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (98426854-17c2-452a-97f9-2f9488e144d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b125ecbe-f4d8-4742-900c-5b5a030b1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b125ecbe-f4d8-4742-900c-5b5a030b1496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-999180533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af1a825-93af-4855-8b02-12de7eee299c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:42Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108d039f-9e86-4b7e-a497-2cf103c9830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (108d039f-9e86-4b7e-a497-2cf103c9830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac672b39-c31a-4dcb-ad2d-60840b4eac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:26:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-93c903de-3624-4765-8486-05f53756e484 tempest-VolumeQuotasAdminTestJSON-871264618 None] Transfer volume completed successfully. Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac672b39-c31a-4dcb-ad2d-60840b4eac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5af1a825-93af-4855-8b02-12de7eee299c', 'volume_name': 'volume-5af1a825-93af-4855-8b02-12de7eee299c', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2db94ec-1edc-4135-b373-83af17acf089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2db94ec-1edc-4135-b373-83af17acf089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce994c1-5fbf-4780-8f23-ff8e01114bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:42 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Volume 5af1a825-93af-4855-8b02-12de7eee299c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5af1a825-93af-4855-8b02-12de7eee299c', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 22:26:42 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Trying to clone 5af1a825-93af-4855-8b02-12de7eee299c from image 7f51a389-75a1-4170-8607-9bba700950bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Acquiring lock "cinder-be8c7505-e358-42fe-947e-b9805fe91686-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-c7f973c2-9bc0-4bb9-8a3b-e8b7d4270d75 req-3842587e-d0c8-48be-8e59-1c8ae78c7417 tempest-TestShelveInstance-1268324992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-c7f973c2-9bc0-4bb9-8a3b-e8b7d4270d75 req-3842587e-d0c8-48be-8e59-1c8ae78c7417 tempest-TestShelveInstance-1268324992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Lock "cinder-be8c7505-e358-42fe-947e-b9805fe91686-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-c7f973c2-9bc0-4bb9-8a3b-e8b7d4270d75 req-3842587e-d0c8-48be-8e59-1c8ae78c7417 tempest-TestShelveInstance-1268324992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Acquiring lock "cinder-quobyte-be8c7505-e358-42fe-947e-b9805fe91686" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Lock "cinder-quobyte-be8c7505-e358-42fe-947e-b9805fe91686" acquired by "delete_volume" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63a6be6-43db-4173-8601-8189625a13a0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-c7f973c2-9bc0-4bb9-8a3b-e8b7d4270d75 req-3842587e-d0c8-48be-8e59-1c8ae78c7417 tempest-TestShelveInstance-1268324992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3f71d05-5506-4593-ab81-d2daf1374ef5', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:26:43 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-c7f973c2-9bc0-4bb9-8a3b-e8b7d4270d75 req-3842587e-d0c8-48be-8e59-1c8ae78c7417 tempest-TestShelveInstance-1268324992 None] attachment_update completed successfully. Nov 05 22:26:43 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 Nov 05 22:26:43 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:26:43 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Image download 20.69 MB at 20.69 MB/s Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8871c4e4-95dd-4cf6-bd22-b6586c6232ad]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:43 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD Nov 05 22:26:43 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:44 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686" returned: 0 in 0.687s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:44 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686 Nov 05 22:26:44 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:44 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc is fetched for user 90e5d6839d3e4712829179f93e4a5ae6. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:26:44 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[33781cb6-6118-44f2-98ad-c67271cd68f1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-be8c7505-e358-42fe-947e-b9805fe91686" returned: 0 in 0.351s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Lock "cinder-quobyte-be8c7505-e358-42fe-947e-b9805fe91686" released by "delete_volume" :: held 1.120s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Created reservations ['2d93b287-7154-43b4-9ae5-0d2de9e9c9d2', '70305073-d027-4549-98c6-0b32ac846b9a', '49b124b5-4691-407d-9d06-d1c4ea4c42ad', 'a1fe81fd-7d71-40fe-9d04-2ab7b58c4ac3'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:44 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD Nov 05 22:26:44 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:44 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:44 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:44 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-999180533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5af1a825-93af-4855-8b02-12de7eee299c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:42Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Creating volume 5af1a825-93af-4855-8b02-12de7eee299c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:44 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:44 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c 1073741824 Nov 05 22:26:44 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:44 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.366s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:44 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:44 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Deleted volume successfully. Nov 05 22:26:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1b79a0b0-85d7-46fa-abba-1e08c0c93197 tempest-VolumeQuotasAdminTestJSON-1387475383 None] Lock "cinder-be8c7505-e358-42fe-947e-b9805fe91686-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:45 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c 1073741824" returned: 0 in 0.613s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:45 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c Nov 05 22:26:45 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:45 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c" returned: 0 in 0.377s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:45 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:45 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Attempting download of 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume 5af1a825-93af-4855-8b02-12de7eee299c. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:26:46 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c7e40f-0757-4492-a571-3820c815df5a]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_f7yjzd4_ {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:46 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_f7yjzd4_ Nov 05 22:26:46 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:46 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_f7yjzd4_" returned: 0 in 0.586s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_f7yjzd4_ {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:46 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_f7yjzd4_ Nov 05 22:26:46 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:47 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_f7yjzd4_" returned: 1 in 0.555s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f51a389-75a1-4170-8607-9bba700950bc_f7yjzd4_' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:26:47 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf6b72c-0d43-400c-9e40-7438bf675d8e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:47 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD Nov 05 22:26:47 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:48 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD" returned: 0 in 0.922s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:48 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] 7f51a389-75a1-4170-8607-9bba700950bc was qcow2, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:26:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:48 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c Nov 05 22:26:48 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:51 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c" returned: 0 in 2.916s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f51a389-75a1-4170-8607-9bba700950bc_fl7ttmeidevstack@QuobyteHD, size 112.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:26:51 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Converted 112.00 MB image at 38.36 MB/s Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:51 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c 1G Nov 05 22:26:51 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:51 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c 1G" returned: 0 in 0.543s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Downloaded image 7f51a389-75a1-4170-8607-9bba700950bc ((None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}])) to volume 5af1a825-93af-4855-8b02-12de7eee299c successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Temporary image 7f51a389-75a1-4170-8607-9bba700950bc for user 90e5d6839d3e4712829179f93e4a5ae6 is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Marking volume 5af1a825-93af-4855-8b02-12de7eee299c as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=83,cinder:UPDATE=106,cinder:DELETE=10,cinder:INSERT=32 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Copying metadata from image 7f51a389-75a1-4170-8607-9bba700950bc to 5af1a825-93af-4855-8b02-12de7eee299c. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Creating volume glance metadata for volume 5af1a825-93af-4855-8b02-12de7eee299c backed by image 7f51a389-75a1-4170-8607-9bba700950bc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce994c1-5fbf-4780-8f23-ff8e01114bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5af1a825-93af-4855-8b02-12de7eee299c', 'volume_size': 1, 'image_id': '7f51a389-75a1-4170-8607-9bba700950bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f51a389-75a1-4170-8607-9bba700950bc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6186d3dd01dd4a4abc072c9c83dccfd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f51a389-75a1-4170-8607-9bba700950bc', 'created_at': datetime.datetime(2026, 11, 5, 21, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f51a389-75a1-4170-8607-9bba700950bc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6edf000-dd30-48eb-ba2c-8eb034a7454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Volume volume-5af1a825-93af-4855-8b02-12de7eee299c (5af1a825-93af-4855-8b02-12de7eee299c): created successfully Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6edf000-dd30-48eb-ba2c-8eb034a7454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (98426854-17c2-452a-97f9-2f9488e144d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0e91a09b-9921-411a-9bc7-e5071d2ebf1a tempest-VolumesGetTest-21270069 None] Created volume successfully. Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (1a90bd78-86a8-40f8-8ce8-68d2e1ed0fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba98ae1-e3fe-427f-8c79-249e2f989a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba98ae1-e3fe-427f-8c79-249e2f989a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-865959088',display_name='tempest-VolumesGetTest-Volume-1591429096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd37852-5c24-4218-8cd2-2b266852df23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:54Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b405985-21cb-49c1-8197-c0486cd7c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b405985-21cb-49c1-8197-c0486cd7c206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02004b7-7981-4e30-9b21-b838dedd3b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02004b7-7981-4e30-9b21-b838dedd3b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd37852-5c24-4218-8cd2-2b266852df23', 'volume_name': 'volume-bfd37852-5c24-4218-8cd2-2b266852df23', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c450b6b-fe3a-4b45-b710-49871bcc85c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c450b6b-fe3a-4b45-b710-49871bcc85c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd055683-67e4-45c6-9a7d-a2d71f45ffff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:53 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Volume bfd37852-5c24-4218-8cd2-2b266852df23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd37852-5c24-4218-8cd2-2b266852df23', 'volume_size': 1} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-865959088',display_name='tempest-VolumesGetTest-Volume-1591429096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd37852-5c24-4218-8cd2-2b266852df23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea1d5353e17499d8d375d1aa2200239',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:54Z,use_quota=True,user_id='90e5d6839d3e4712829179f93e4a5ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Creating volume bfd37852-5c24-4218-8cd2-2b266852df23 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:53 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:53 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 1073741824 Nov 05 22:26:53 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:54 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 1073741824" returned: 0 in 0.650s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:54 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 Nov 05 22:26:54 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:54 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23" returned: 0 in 0.417s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd055683-67e4-45c6-9a7d-a2d71f45ffff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd37852-5c24-4218-8cd2-2b266852df23', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903d8c14-3cd9-4510-a2d9-d7d4678c0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Volume volume-bfd37852-5c24-4218-8cd2-2b266852df23 (bfd37852-5c24-4218-8cd2-2b266852df23): created successfully Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903d8c14-3cd9-4510-a2d9-d7d4678c0979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Flow 'volume_create_manager' (1a90bd78-86a8-40f8-8ce8-68d2e1ed0fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-89ab5cec-7c39-4c9c-a1a4-3f837100c492 tempest-VolumesGetTest-21270069 None] Created volume successfully. Nov 05 22:26:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-bfd37852-5c24-4218-8cd2-2b266852df23-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Lock "cinder-bfd37852-5c24-4218-8cd2-2b266852df23-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-bfd37852-5c24-4218-8cd2-2b266852df23" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-bfd37852-5c24-4218-8cd2-2b266852df23" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef03ea-1fd2-47d1-9df3-339828893e9d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:56 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 Nov 05 22:26:56 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:56 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23" returned: 0 in 0.443s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:56 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23 Nov 05 22:26:56 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:56 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-bfd37852-5c24-4218-8cd2-2b266852df23" returned: 0 in 0.253s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-bfd37852-5c24-4218-8cd2-2b266852df23" released by "delete_volume" :: held 0.769s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Created reservations ['fb3f13d6-63e4-4041-af37-7f11b04e4378', 'a2e71f66-ec1f-4734-b3bb-f75e482e6f5f', '76de9d27-0e57-4c1c-8aba-2a04f9ed9682', '374e1ec6-39b5-4f48-99fe-01362c0a0a88'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:57 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:57 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-5af1a825-93af-4855-8b02-12de7eee299c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Lock "cinder-5af1a825-93af-4855-8b02-12de7eee299c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:57 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Acquiring lock "cinder-quobyte-5af1a825-93af-4855-8b02-12de7eee299c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.350s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Deleted volume successfully. Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-5af1a825-93af-4855-8b02-12de7eee299c" acquired by "delete_volume" :: waited 0.052s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-da5377e6-0698-419f-919d-53729ba8b82e tempest-VolumesGetTest-21270069 None] Lock "cinder-bfd37852-5c24-4218-8cd2-2b266852df23-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8cc52-0eab-4d25-9c94-37a728646f87]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:57 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c Nov 05 22:26:57 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Flow 'volume_create_manager' (b099b688-072d-41cd-a506-14fc12c66a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff39c5f3-89bd-4e99-b116-8e97e068abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff39c5f3-89bd-4e99-b116-8e97e068abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2044260351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f8cb7e-43e3-4e87-b27e-a9ea28580745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa934940cfd4eb2bf0e0f4e1f199847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:58Z,use_quota=True,user_id='199d87b8581f4f8f8f222854b174f9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d618f3b6-ffca-4457-9f21-bf78571cb146),volume_type_id=d618f3b6-ffca-4457-9f21-bf78571cb146)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09998f3f-9a97-41ab-a664-e1c99c157158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09998f3f-9a97-41ab-a664-e1c99c157158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4e1eb9-907a-46f0-9b8b-729d7a469836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4e1eb9-907a-46f0-9b8b-729d7a469836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f8cb7e-43e3-4e87-b27e-a9ea28580745', 'volume_name': 'volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4c4e97-d49b-490b-ada3-a61f5cd21d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4c4e97-d49b-490b-ada3-a61f5cd21d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583b024-8811-433e-930c-dc2ffe22dab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:57 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Volume 03f8cb7e-43e3-4e87-b27e-a9ea28580745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745', 'volume_size': 1} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2044260351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f8cb7e-43e3-4e87-b27e-a9ea28580745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa934940cfd4eb2bf0e0f4e1f199847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:26:58Z,use_quota=True,user_id='199d87b8581f4f8f8f222854b174f9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d618f3b6-ffca-4457-9f21-bf78571cb146),volume_type_id=d618f3b6-ffca-4457-9f21-bf78571cb146)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Creating volume 03f8cb7e-43e3-4e87-b27e-a9ea28580745 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:26:57 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:57 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:57 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 1073741824 Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c" returned: 0 in 0.453s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:57 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:57 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c Nov 05 22:26:57 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:58 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5af1a825-93af-4855-8b02-12de7eee299c" returned: 0 in 0.268s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Lock "cinder-quobyte-5af1a825-93af-4855-8b02-12de7eee299c" released by "delete_volume" :: held 0.790s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Created reservations ['87dc294b-9d39-40f2-a99b-0dbb3e0e6f91', 'a8d02d9a-468d-4759-a089-e9f265404938', '33c3d172-567c-4208-9eb5-cf358d29753a', '74f606f9-18db-4f48-b031-e25202ed17a2'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:58 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 1073741824" returned: 0 in 0.479s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:58 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:26:58 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:26:58 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 Nov 05 22:26:58 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:26:58 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.385s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:26:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Deleted volume successfully. Nov 05 22:26:58 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745" returned: 0 in 0.338s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c28f6268-14d2-4060-ae5c-de6434acea90 tempest-VolumesGetTest-21270069 None] Lock "cinder-5af1a825-93af-4855-8b02-12de7eee299c-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e583b024-8811-433e-930c-dc2ffe22dab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c8fc58-82bc-47bf-a9ae-e7af1fc23203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:26:58 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Volume volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 (03f8cb7e-43e3-4e87-b27e-a9ea28580745): created successfully Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c8fc58-82bc-47bf-a9ae-e7af1fc23203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:26:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Flow 'volume_create_manager' (b099b688-072d-41cd-a506-14fc12c66a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:26:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0641f2fd-fc58-418e-9fe4-8331a9897f64 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Created volume successfully. Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:00 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:00 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:00 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.273s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:00 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a94841ba-b029-45a7-8b80-fb6e35407e41 tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Retype volume completed successfully. Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Acquiring lock "cinder-03f8cb7e-43e3-4e87-b27e-a9ea28580745-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "cinder-03f8cb7e-43e3-4e87-b27e-a9ea28580745-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Acquiring lock "cinder-quobyte-03f8cb7e-43e3-4e87-b27e-a9ea28580745" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "cinder-quobyte-03f8cb7e-43e3-4e87-b27e-a9ea28580745" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[595a38ae-f9c8-415e-9c21-3bad263530b3]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:02 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 Nov 05 22:27:02 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:02 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745" returned: 0 in 0.419s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:02 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745 Nov 05 22:27:02 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Flow 'volume_create_manager' (cf84135d-1f0b-4583-98b9-13983f4136de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64725627-0202-400f-9afe-4d1c975927c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:02 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03f8cb7e-43e3-4e87-b27e-a9ea28580745" returned: 0 in 0.406s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64725627-0202-400f-9afe-4d1c975927c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1673370880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21504917-b8e0-46e5-8f75-844da8ab551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb84de3a6aa848019bf6d54541d9a69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:03Z,use_quota=True,user_id='9b0a8ac153214e2f9ac0b50b473881df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8958b395-7344-42ae-b1eb-ce593eed7d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8958b395-7344-42ae-b1eb-ce593eed7d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c021a-1b48-4b26-ac54-32faff04a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818c021a-1b48-4b26-ac54-32faff04a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21504917-b8e0-46e5-8f75-844da8ab551f', 'volume_name': 'volume-21504917-b8e0-46e5-8f75-844da8ab551f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7590c3-e261-424e-ba71-66c6ad67461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7590c3-e261-424e-ba71-66c6ad67461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e9e8ec-06fc-48a2-9bde-c0b82b25b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:03 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Volume 21504917-b8e0-46e5-8f75-844da8ab551f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21504917-b8e0-46e5-8f75-844da8ab551f', 'volume_size': 1} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1673370880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21504917-b8e0-46e5-8f75-844da8ab551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb84de3a6aa848019bf6d54541d9a69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:03Z,use_quota=True,user_id='9b0a8ac153214e2f9ac0b50b473881df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Creating volume 21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:03 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "cinder-quobyte-03f8cb7e-43e3-4e87-b27e-a9ea28580745" released by "delete_volume" :: held 0.982s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:03 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f 1073741824 Nov 05 22:27:03 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:03 devstack cinder-volume[87085]: WARNING cinder.quota [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:27:03 devstack cinder-volume[87085]: WARNING cinder.quota [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Created reservations ['df87dde8-76b7-4568-ae8a-28025590a04a', '69698207-e554-496d-af57-4a90b2610000', 'e1a3b204-0e48-467b-91a6-10c96cdc3e17', '3a6cd42f-36b0-4988-b10b-899adf4ea4be'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:03 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:03 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:03 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.317s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Deleted volume successfully. Nov 05 22:27:03 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f 1073741824" returned: 0 in 0.594s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f589ae2a-39f3-4f95-9fa4-ab8e03b2a8dd tempest-VolumeRetypeWithoutMigrationTest-1583467836 None] Lock "cinder-03f8cb7e-43e3-4e87-b27e-a9ea28580745-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:03 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f Nov 05 22:27:03 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:04 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e9e8ec-06fc-48a2-9bde-c0b82b25b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21504917-b8e0-46e5-8f75-844da8ab551f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31eb4b7e-6c5c-4ec6-87bc-4b2c638e43c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:04 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Volume volume-21504917-b8e0-46e5-8f75-844da8ab551f (21504917-b8e0-46e5-8f75-844da8ab551f): created successfully Nov 05 22:27:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31eb4b7e-6c5c-4ec6-87bc-4b2c638e43c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Flow 'volume_create_manager' (cf84135d-1f0b-4583-98b9-13983f4136de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-32cb0dba-b20e-46ce-855c-7ac0dbfb50c1 tempest-VolumesSnapshotListTestJSON-377049724 None] Created volume successfully. Nov 05 22:27:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Creating offline snapshot 95873fd8-b933-45cd-b11d-980e49255b59 of volume 21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b812cd0-cb8a-44d2-99a0-b28879e9a74c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:05 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f Nov 05 22:27:05 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:06 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f" returned: 0 in 0.871s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:06 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 1G Nov 05 22:27:06 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:07 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 1G" returned: 0 in 0.713s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:07 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 Nov 05 22:27:07 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:07 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59" returned: 0 in 0.547s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:07 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 is being set with open permissions: ugo+rw Nov 05 22:27:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:07 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 Nov 05 22:27:07 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:08 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:08 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.info Nov 05 22:27:08 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:08 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.info" returned: 0 in 0.559s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:08 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.info is being set with open permissions: ugo+rw Nov 05 22:27:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:08 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.info Nov 05 22:27:08 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:09 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.info" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.666s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7097494d-9750-4c8e-9e44-fd0cbcf601f7 tempest-VolumesSnapshotListTestJSON-377049724 None] Create snapshot completed successfully Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Creating offline snapshot caa5d40d-a978-4234-a954-64d911441654 of volume 21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ed801e-9768-4bff-b557-b54e0607d53a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:10 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 Nov 05 22:27:10 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:10 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59" returned: 0 in 0.490s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21504917-b8e0-46e5-8f75-844da8ab551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:10 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 1G Nov 05 22:27:10 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:11 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 1G" returned: 0 in 0.488s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:11 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 Nov 05 22:27:11 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:11 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:11 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 is being set with open permissions: ugo+rw Nov 05 22:27:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:11 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 Nov 05 22:27:11 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:11 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654" returned: 0 in 0.269s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.709s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2a56b2c8-8509-4326-b813-8ecc8d8cbb7a tempest-VolumesSnapshotListTestJSON-377049724 None] Create snapshot completed successfully Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Creating offline snapshot f834e1fb-4e33-43b1-a876-2a45dd288ba5 of volume 21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ba52d4-bf0e-4cb9-b64c-22e9b4d2dfa7]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:12 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 Nov 05 22:27:12 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:12 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654" returned: 0 in 0.452s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21504917-b8e0-46e5-8f75-844da8ab551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:13 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 1G Nov 05 22:27:13 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Flow 'volume_create_manager' (46258382-a0ef-4c9b-907a-97458d16b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92939307-abe7-4ab4-845a-70c1c53d4481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92939307-abe7-4ab4-845a-70c1c53d4481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-757991204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9541b68f-8fe7-4da7-906c-0c8ab340d430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922df37652e34f3796263111294f32a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:13Z,use_quota=True,user_id='8f0fc7299692466caa4da4ee1eccb75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d092fd0b-e975-4d54-b950-b56697474546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d092fd0b-e975-4d54-b950-b56697474546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5f3b88-bab7-4d11-a928-4d65542f98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5f3b88-bab7-4d11-a928-4d65542f98f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9541b68f-8fe7-4da7-906c-0c8ab340d430', 'volume_name': 'volume-9541b68f-8fe7-4da7-906c-0c8ab340d430', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:13 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e75f17-9511-43c0-8102-1c60d92a3cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e75f17-9511-43c0-8102-1c60d92a3cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c2c295-353b-4945-bf53-434ccb2f5fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Volume 9541b68f-8fe7-4da7-906c-0c8ab340d430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9541b68f-8fe7-4da7-906c-0c8ab340d430', 'volume_size': 1} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 1G" returned: 0 in 0.606s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:13 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 Nov 05 22:27:13 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:13 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5" returned: 0 in 0.271s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:13 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 is being set with open permissions: ugo+rw Nov 05 22:27:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:13 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 Nov 05 22:27:13 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:14 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5" returned: 0 in 0.244s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.693s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-757991204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9541b68f-8fe7-4da7-906c-0c8ab340d430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922df37652e34f3796263111294f32a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:13Z,use_quota=True,user_id='8f0fc7299692466caa4da4ee1eccb75b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Creating volume 9541b68f-8fe7-4da7-906c-0c8ab340d430 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:14 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:14 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 1073741824 Nov 05 22:27:14 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:14 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b4b63276-2228-4060-9edb-d9b499e01586 tempest-VolumesSnapshotListTestJSON-377049724 None] Create snapshot completed successfully Nov 05 22:27:14 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 1073741824" returned: 0 in 0.464s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:14 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 Nov 05 22:27:14 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:14 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430" returned: 0 in 0.287s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c2c295-353b-4945-bf53-434ccb2f5fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9541b68f-8fe7-4da7-906c-0c8ab340d430', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642d4728-41a0-4fd6-a7ec-e7fef0083bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:14 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Volume volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 (9541b68f-8fe7-4da7-906c-0c8ab340d430): created successfully Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642d4728-41a0-4fd6-a7ec-e7fef0083bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Flow 'volume_create_manager' (46258382-a0ef-4c9b-907a-97458d16b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:14 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-643a193d-d6c0-4ba8-9e41-a2e588552d84 tempest-VolumesServicesTestJSON-1603523629 None] Created volume successfully. Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-f834e1fb-4e33-43b1-a876-2a45dd288ba5-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-f834e1fb-4e33-43b1-a876-2a45dd288ba5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-quobyte-f834e1fb-4e33-43b1-a876-2a45dd288ba5" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-f834e1fb-4e33-43b1-a876-2a45dd288ba5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Deleting offline snapshot f834e1fb-4e33-43b1-a876-2a45dd288ba5 of volume 21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] snapshot_file for this snap is: volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Acquiring lock "cinder-9541b68f-8fe7-4da7-906c-0c8ab340d430-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[313afc41-19be-4906-8383-5fdda78b5096]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Lock "cinder-9541b68f-8fe7-4da7-906c-0c8ab340d430-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Acquiring lock "cinder-quobyte-9541b68f-8fe7-4da7-906c-0c8ab340d430" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Lock "cinder-quobyte-9541b68f-8fe7-4da7-906c-0c8ab340d430" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a52dd18-30b3-4959-9b60-706b2296c756]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:16 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 Nov 05 22:27:16 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:16 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 Nov 05 22:27:16 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:16 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5" returned: 0 in 0.489s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21504917-b8e0-46e5-8f75-844da8ab551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fd2a3f-6892-43be-ab16-ca7b333a03e8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:16 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430" returned: 0 in 0.448s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:16 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430 Nov 05 22:27:16 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:16 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 Nov 05 22:27:16 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:16 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9541b68f-8fe7-4da7-906c-0c8ab340d430" returned: 0 in 0.259s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Lock "cinder-quobyte-9541b68f-8fe7-4da7-906c-0c8ab340d430" released by "delete_volume" :: held 0.762s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Created reservations ['1057a3e6-ca43-4ee8-9150-c6480a4bc8f0', '20eec774-6765-4b0c-b02e-aa634c20fc7b', '8b7a8d2a-9368-4c4b-84d2-8090801c47c1', 'c9bab489-45af-46a1-ab08-d8d8a7648bd9'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:16 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654" returned: 0 in 0.430s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21504917-b8e0-46e5-8f75-844da8ab551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:16 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 Nov 05 22:27:16 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:16 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:16 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:17 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.367s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:17 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Deleted volume successfully. Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f311708c-3543-4457-bedc-dcc71d65a725 tempest-VolumesServicesTestJSON-1603523629 None] Lock "cinder-9541b68f-8fe7-4da7-906c-0c8ab340d430-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:17 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5" returned: 0 in 0.690s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:17 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5 Nov 05 22:27:17 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:17 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.f834e1fb-4e33-43b1-a876-2a45dd288ba5" returned: 0 in 0.360s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-f834e1fb-4e33-43b1-a876-2a45dd288ba5" released by "_delete_snapshot" :: held 2.122s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" released by "delete_snapshot" :: held 2.156s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:17 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Created reservations ['a63126d1-477e-4165-b9d6-13c2201b15b6', '4b9e9973-d4a1-4b2f-adde-aff2620c628f', '455f649e-76fb-441a-9454-6cfa07403f4e', '798668b6-91b5-4fba-946c-9ac4bc0a57a6'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Delete snapshot completed successfully. Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8dba3d4b-fcf9-43c3-a6af-e36c51d1b3cd tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-f834e1fb-4e33-43b1-a876-2a45dd288ba5-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-caa5d40d-a978-4234-a954-64d911441654-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-caa5d40d-a978-4234-a954-64d911441654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-quobyte-caa5d40d-a978-4234-a954-64d911441654" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-caa5d40d-a978-4234-a954-64d911441654" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Deleting offline snapshot caa5d40d-a978-4234-a954-64d911441654 of volume 21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] snapshot_file for this snap is: volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7615b6f1-bc8b-44cd-a94b-32bb2c9561a6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:19 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 Nov 05 22:27:19 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:19 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654" returned: 0 in 0.397s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21504917-b8e0-46e5-8f75-844da8ab551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55ffeb6-ae4e-4544-87e3-38a60aa3c83c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:19 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 Nov 05 22:27:19 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:19 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59" returned: 0 in 0.375s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21504917-b8e0-46e5-8f75-844da8ab551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:19 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 Nov 05 22:27:19 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:20 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:20 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654 Nov 05 22:27:20 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:20 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.caa5d40d-a978-4234-a954-64d911441654" returned: 0 in 0.258s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-caa5d40d-a978-4234-a954-64d911441654" released by "_delete_snapshot" :: held 1.581s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" released by "delete_snapshot" :: held 1.614s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Created reservations ['a13ca16b-c3dc-4802-ab06-58c15f84b7db', 'bd1822f9-8d9c-4ff7-8af1-8b60a3a00456', 'f99bd34a-908d-4e09-b6ac-ff4dc95c7ace', 'a50a5e73-7c22-4350-b331-09ca80b849d1'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Delete snapshot completed successfully. Nov 05 22:27:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b89b3ac-49bb-4e08-b84c-942bf1938b2b tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-caa5d40d-a978-4234-a954-64d911441654-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-95873fd8-b933-45cd-b11d-980e49255b59-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-95873fd8-b933-45cd-b11d-980e49255b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-quobyte-95873fd8-b933-45cd-b11d-980e49255b59" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-95873fd8-b933-45cd-b11d-980e49255b59" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Deleting offline snapshot 95873fd8-b933-45cd-b11d-980e49255b59 of volume 21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] snapshot_file for this snap is: volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0001f3-0b68-4d6d-815f-5ce244e13639]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:21 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 Nov 05 22:27:21 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:21 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59" returned: 0 in 0.376s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21504917-b8e0-46e5-8f75-844da8ab551f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e663bd-d35d-4a5f-93e0-7476b98e6766]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:21 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f Nov 05 22:27:21 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:21 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f" returned: 0 in 0.367s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:21 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 Nov 05 22:27:21 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:22 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59" returned: 0 in 0.339s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:22 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59 Nov 05 22:27:22 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:22 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f.95873fd8-b933-45cd-b11d-980e49255b59" returned: 0 in 0.252s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-95873fd8-b933-45cd-b11d-980e49255b59" released by "_delete_snapshot" :: held 1.454s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" released by "delete_snapshot" :: held 1.479s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:22 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Created reservations ['53175d4f-a3b1-49f8-b481-325052aa98e0', 'a608556c-8ff4-4666-be95-143ee4011d6e', 'f4e3fe54-b4b3-4382-a09d-d4fb56446720', 'e707eafd-c59d-4700-8726-0c0464967528'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:22 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Delete snapshot completed successfully. Nov 05 22:27:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9ac743d1-68de-4f10-8bf5-0bb936efe93a tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-95873fd8-b933-45cd-b11d-980e49255b59-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-21504917-b8e0-46e5-8f75-844da8ab551f-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-21504917-b8e0-46e5-8f75-844da8ab551f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" acquired by "delete_volume" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4261e84-e9ee-448a-b2c7-b56e2b636066]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:23 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f Nov 05 22:27:23 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:23 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f" returned: 0 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:23 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f Nov 05 22:27:23 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:24 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-21504917-b8e0-46e5-8f75-844da8ab551f" returned: 0 in 0.252s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-quobyte-21504917-b8e0-46e5-8f75-844da8ab551f" released by "delete_volume" :: held 0.698s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Created reservations ['c6fbef30-8542-4a5a-917b-ad7fc0859c60', '6375968e-75a8-4ec7-97de-f6bdd1d7a5e1', 'a488818c-25ef-4f4b-8907-6c314260a7ec', '0a7f6332-aa5e-4cf2-acb1-54ddcf3ed242'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:24 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:24 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:24 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.270s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:24 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Deleted volume successfully. Nov 05 22:27:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5b3e0dc3-57a2-4043-b432-54298d43139f tempest-VolumesSnapshotListTestJSON-377049724 None] Lock "cinder-21504917-b8e0-46e5-8f75-844da8ab551f-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Flow 'volume_create_manager' (a8748e82-eca6-4b40-868b-d2a1a132f36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de50db32-6d5e-41cd-9b42-92bb36cec509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de50db32-6d5e-41cd-9b42-92bb36cec509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fdaa30-219d-44d1-abb0-2cc2815f81e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b0802818dc4b1480f7b19a344e353a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:28Z,use_quota=True,user_id='3a7559c0a35a46d18e38dc309c02d342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05c66e1-698d-4e79-812b-4623572910f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05c66e1-698d-4e79-812b-4623572910f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39e00e8-d236-412e-a862-a440597fcd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39e00e8-d236-412e-a862-a440597fcd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fdaa30-219d-44d1-abb0-2cc2815f81e1', 'volume_name': 'volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d66782e-5f8e-43bf-8f66-0d9882ded938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d66782e-5f8e-43bf-8f66-0d9882ded938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe8f7e3-0c28-4688-a706-6032733e9965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:28 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Volume 89fdaa30-219d-44d1-abb0-2cc2815f81e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1', 'volume_size': 1} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fdaa30-219d-44d1-abb0-2cc2815f81e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b0802818dc4b1480f7b19a344e353a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:28Z,use_quota=True,user_id='3a7559c0a35a46d18e38dc309c02d342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Creating volume 89fdaa30-219d-44d1-abb0-2cc2815f81e1 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:28 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:28 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 1073741824 Nov 05 22:27:28 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:28 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 1073741824" returned: 0 in 0.471s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:28 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 Nov 05 22:27:28 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:29 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1" returned: 0 in 0.278s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe8f7e3-0c28-4688-a706-6032733e9965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d466b192-dbff-4812-ba90-a5dcbe2c61ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:29 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Volume volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 (89fdaa30-219d-44d1-abb0-2cc2815f81e1): created successfully Nov 05 22:27:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d466b192-dbff-4812-ba90-a5dcbe2c61ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Flow 'volume_create_manager' (a8748e82-eca6-4b40-868b-d2a1a132f36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-de737df9-ed02-4a6e-b5c4-a551204c825c tempest-CinderUnicodeTest-1906335348 None] Created volume successfully. Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Flow 'volume_create_manager' (be688846-2e65-4423-bb7f-1a0f2d3c98f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662e7156-2f21-4e5f-85d1-9ef7e58abb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=144,cinder:SELECT=134,cinder:DELETE=9,cinder:INSERT=42 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662e7156-2f21-4e5f-85d1-9ef7e58abb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2121711117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4f110b-0147-49eb-a843-a19ce1b29525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b0802818dc4b1480f7b19a344e353a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:31Z,use_quota=True,user_id='3a7559c0a35a46d18e38dc309c02d342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c574319b-3489-4fc6-8bd8-ac91e2027473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c574319b-3489-4fc6-8bd8-ac91e2027473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f89225a-baac-4fd7-a128-9a7638e2e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f89225a-baac-4fd7-a128-9a7638e2e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4f110b-0147-49eb-a843-a19ce1b29525', 'volume_name': 'volume-9c4f110b-0147-49eb-a843-a19ce1b29525', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bce04e-1441-4189-8c17-dd9fd6ac4edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bce04e-1441-4189-8c17-dd9fd6ac4edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb32f01-1635-44d4-bb71-206493296753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Volume 9c4f110b-0147-49eb-a843-a19ce1b29525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4f110b-0147-49eb-a843-a19ce1b29525', 'volume_size': 1} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2121711117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4f110b-0147-49eb-a843-a19ce1b29525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b0802818dc4b1480f7b19a344e353a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:31Z,use_quota=True,user_id='3a7559c0a35a46d18e38dc309c02d342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Creating volume 9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:31 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:31 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 1073741824 Nov 05 22:27:31 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:31 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 1073741824" returned: 0 in 0.642s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:31 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 Nov 05 22:27:31 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:32 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525" returned: 0 in 0.443s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb32f01-1635-44d4-bb71-206493296753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4f110b-0147-49eb-a843-a19ce1b29525', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2dd21c7-8510-4fb3-85ad-343cc21eba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Volume volume-9c4f110b-0147-49eb-a843-a19ce1b29525 (9c4f110b-0147-49eb-a843-a19ce1b29525): created successfully Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2dd21c7-8510-4fb3-85ad-343cc21eba69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Flow 'volume_create_manager' (be688846-2e65-4423-bb7f-1a0f2d3c98f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e2fc6ec1-77f6-4bad-a4d7-4f4934860e60 tempest-CinderUnicodeTest-1906335348 None] Created volume successfully. Nov 05 22:27:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-7d83d576-2d27-47e7-aa03-97ac0983f90b req-ce6de709-e5ce-46e6-a7dd-25f59d8ef419 tempest-TestMinimumBasicScenario-726444295 None] Terminate volume connection completed successfully. Nov 05 22:27:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-7d83d576-2d27-47e7-aa03-97ac0983f90b req-ce6de709-e5ce-46e6-a7dd-25f59d8ef419 tempest-TestMinimumBasicScenario-726444295 None] Deleting attachment b7dfab7c-519e-450e-bfa8-786abaa0281a. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Acquiring lock "cinder-6b438278-2a30-4fda-beb9-69f6ef30efdd-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Lock "cinder-6b438278-2a30-4fda-beb9-69f6ef30efdd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Acquiring lock "cinder-quobyte-6b438278-2a30-4fda-beb9-69f6ef30efdd" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Lock "cinder-quobyte-6b438278-2a30-4fda-beb9-69f6ef30efdd" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9ee337-ffee-45d1-9451-a6d1d52573dc]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Creating offline snapshot 89ed12ca-1f8c-4dd6-a25a-4984aa41921b of volume 9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d2162a-7beb-43c7-b571-6ff307429b75]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:33 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd Nov 05 22:27:33 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:33 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 Nov 05 22:27:33 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:34 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd" returned: 0 in 0.555s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:34 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:34 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd Nov 05 22:27:34 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:34 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b 1G Nov 05 22:27:34 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:34 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b438278-2a30-4fda-beb9-69f6ef30efdd" returned: 0 in 0.504s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Lock "cinder-quobyte-6b438278-2a30-4fda-beb9-69f6ef30efdd" released by "delete_volume" :: held 1.166s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Created reservations ['560fda1e-18d7-458e-9b03-61a6a8de38a7', 'f56fe375-5df8-4315-b239-7d6f5f6ad9b4', 'eb4b17ed-a6bf-4f0f-b311-9633a92f0d36', '05cde7ac-79a1-4136-bcc0-81a55e20d6ba'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:34 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b 1G" returned: 0 in 0.809s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c4f110b-0147-49eb-a843-a19ce1b29525 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:34 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:34 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:34 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c4f110b-0147-49eb-a843-a19ce1b29525 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b Nov 05 22:27:34 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-d6f82ba5-861b-4214-9967-bfe3f4df164e req-4f16a6e1-d03f-4728-b97c-f6b4b25c70f2 tempest-TestShelveInstance-1268324992 None] Terminate volume connection completed successfully. Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-d6f82ba5-861b-4214-9967-bfe3f4df164e req-4f16a6e1-d03f-4728-b97c-f6b4b25c70f2 tempest-TestShelveInstance-1268324992 None] Deleting attachment b3f71d05-5506-4593-ab81-d2daf1374ef5. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:27:35 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.370s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Deleted volume successfully. Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5bd632b8-b301-48ed-b949-f2048abe2f0e tempest-TestMinimumBasicScenario-726444295 None] Lock "cinder-6b438278-2a30-4fda-beb9-69f6ef30efdd-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:35 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c4f110b-0147-49eb-a843-a19ce1b29525 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b" returned: 0 in 0.435s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:35 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b is being set with open permissions: ugo+rw Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:35 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b Nov 05 22:27:35 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:35 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:35 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.info Nov 05 22:27:35 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:36 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.info" returned: 0 in 0.348s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:36 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.info is being set with open permissions: ugo+rw Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:36 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.info Nov 05 22:27:36 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:36 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.info" returned: 0 in 0.460s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6423cf2e-f894-47e7-9578-5f0ec965aeac tempest-CinderUnicodeTest-1906335348 None] Create snapshot completed successfully Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "cinder-89ed12ca-1f8c-4dd6-a25a-4984aa41921b-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-89ed12ca-1f8c-4dd6-a25a-4984aa41921b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "cinder-quobyte-9c4f110b-0147-49eb-a843-a19ce1b29525" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-9c4f110b-0147-49eb-a843-a19ce1b29525" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "cinder-quobyte-89ed12ca-1f8c-4dd6-a25a-4984aa41921b" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-89ed12ca-1f8c-4dd6-a25a-4984aa41921b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Deleting offline snapshot 89ed12ca-1f8c-4dd6-a25a-4984aa41921b of volume 9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:27:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] snapshot_file for this snap is: volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:27:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed87a94-52bb-4154-a167-56a0c5ded34c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:37 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b Nov 05 22:27:37 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:37 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b" returned: 0 in 0.445s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c4f110b-0147-49eb-a843-a19ce1b29525(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:27:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3a5294-5ed2-46f3-a16d-1bec74ff7f0b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:37 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 Nov 05 22:27:37 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:38 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525" returned: 0 in 0.533s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:38 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b Nov 05 22:27:38 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:38 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b" returned: 0 in 0.510s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:38 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b Nov 05 22:27:38 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:38 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525.89ed12ca-1f8c-4dd6-a25a-4984aa41921b" returned: 0 in 0.306s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-89ed12ca-1f8c-4dd6-a25a-4984aa41921b" released by "_delete_snapshot" :: held 2.034s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-9c4f110b-0147-49eb-a843-a19ce1b29525" released by "delete_snapshot" :: held 2.070s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Created reservations ['91b3cc82-36e0-44fd-a165-85503a3aef6a', '38c18e86-286a-4ba9-876e-0210ba3f50c5', '77d04d29-56b7-4e3d-9c62-9acb8007271a', '109d4d5e-b4d7-43f2-b564-01446de69c66'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Delete snapshot completed successfully. Nov 05 22:27:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d90bd8de-5691-412e-9f40-b3354e281ed3 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-89ed12ca-1f8c-4dd6-a25a-4984aa41921b-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-bafe9b85-9893-44b0-b72f-9dd618c800c8 req-fcd6ac1b-f0ff-4622-92bc-1dc0e7d29027 tempest-TestShelveInstance-1268324992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-bafe9b85-9893-44b0-b72f-9dd618c800c8 req-fcd6ac1b-f0ff-4622-92bc-1dc0e7d29027 tempest-TestShelveInstance-1268324992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-bafe9b85-9893-44b0-b72f-9dd618c800c8 req-fcd6ac1b-f0ff-4622-92bc-1dc0e7d29027 tempest-TestShelveInstance-1268324992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:39 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-bafe9b85-9893-44b0-b72f-9dd618c800c8 req-fcd6ac1b-f0ff-4622-92bc-1dc0e7d29027 tempest-TestShelveInstance-1268324992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68799738-fde8-409a-9eab-8368c5009311', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:27:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-bafe9b85-9893-44b0-b72f-9dd618c800c8 req-fcd6ac1b-f0ff-4622-92bc-1dc0e7d29027 tempest-TestShelveInstance-1268324992 None] attachment_update completed successfully. Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "cinder-9c4f110b-0147-49eb-a843-a19ce1b29525-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-9c4f110b-0147-49eb-a843-a19ce1b29525-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "cinder-quobyte-9c4f110b-0147-49eb-a843-a19ce1b29525" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:40 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:40 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-9c4f110b-0147-49eb-a843-a19ce1b29525" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[db224a1d-3a15-4f56-96be-f20fe8dca654]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:40 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 Nov 05 22:27:40 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:40 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.421s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:27:40 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525" returned: 0 in 0.497s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:40 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525 Nov 05 22:27:40 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:41 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9c4f110b-0147-49eb-a843-a19ce1b29525" returned: 0 in 0.325s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-9c4f110b-0147-49eb-a843-a19ce1b29525" released by "delete_volume" :: held 0.926s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Created reservations ['c6bcf9db-d2c6-45dc-a365-4a8f1539a638', 'be84ef79-8d4b-499b-bc38-103d8d57f132', '953043cc-8b47-4776-8a59-7318b9a4e536', '72a72625-dd38-4e7b-a6e8-52b74454405d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:41 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:41 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:41 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.283s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Deleted volume successfully. Nov 05 22:27:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-48d7dd7f-f3d6-4eaa-b32c-7a907d11ae69 tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-9c4f110b-0147-49eb-a843-a19ce1b29525-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "cinder-89fdaa30-219d-44d1-abb0-2cc2815f81e1-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-89fdaa30-219d-44d1-abb0-2cc2815f81e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "cinder-quobyte-89fdaa30-219d-44d1-abb0-2cc2815f81e1" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-89fdaa30-219d-44d1-abb0-2cc2815f81e1" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:42 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cdf91f-4e27-47bf-97d3-d4460b50c29a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:42 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 Nov 05 22:27:42 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:43 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1" returned: 0 in 0.368s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:43 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1 Nov 05 22:27:43 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:43 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89fdaa30-219d-44d1-abb0-2cc2815f81e1" returned: 0 in 0.292s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-quobyte-89fdaa30-219d-44d1-abb0-2cc2815f81e1" released by "delete_volume" :: held 0.707s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Created reservations ['f95f2bd0-636c-4e12-a3b7-b74150309851', '714e6097-0a65-4314-bd93-4fe81c242656', 'd6e87ca6-a1cc-413e-8e25-8dd181c23d66', '6eeba822-2d3f-4302-87ab-2f7bb0648ce3'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:43 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:43 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:43 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:43 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Deleted volume successfully. Nov 05 22:27:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8491519f-f353-41b4-8624-746f03b4990e tempest-CinderUnicodeTest-1906335348 None] Lock "cinder-89fdaa30-219d-44d1-abb0-2cc2815f81e1-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Flow 'volume_create_manager' (1b8837dc-2464-4aba-bdbf-96ebc635b2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1404a5a2-4491-46a6-a719-a8cdd381e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1404a5a2-4491-46a6-a719-a8cdd381e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-264099641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640f0f40-e22d-4d9e-842d-eda73ff7cfc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2433f726a754c69b043bfd2e870242e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:48Z,use_quota=True,user_id='43cb9331661842e4ac41c4db9d32c379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c02090-23f0-456f-8546-3f533dce52a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c02090-23f0-456f-8546-3f533dce52a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69129a40-d174-44dc-8c07-ccf9c31246a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69129a40-d174-44dc-8c07-ccf9c31246a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640f0f40-e22d-4d9e-842d-eda73ff7cfc5', 'volume_name': 'volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e557491b-9674-45cd-9264-34a7daa917d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e557491b-9674-45cd-9264-34a7daa917d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9f1b93-56ee-4817-9479-020782c7e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:47 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Volume 640f0f40-e22d-4d9e-842d-eda73ff7cfc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5', 'volume_size': 1} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-264099641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640f0f40-e22d-4d9e-842d-eda73ff7cfc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2433f726a754c69b043bfd2e870242e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:48Z,use_quota=True,user_id='43cb9331661842e4ac41c4db9d32c379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Creating volume 640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:47 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:27:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:47 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 1073741824 Nov 05 22:27:47 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:48 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 1073741824" returned: 0 in 0.846s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:48 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:27:48 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:49 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.447s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9f1b93-56ee-4817-9479-020782c7e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5071b3dd-8e8f-4fce-88e6-3cfbaf357fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Volume volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 (640f0f40-e22d-4d9e-842d-eda73ff7cfc5): created successfully Nov 05 22:27:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5071b3dd-8e8f-4fce-88e6-3cfbaf357fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Flow 'volume_create_manager' (1b8837dc-2464-4aba-bdbf-96ebc635b2c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f3371786-ca10-455d-94ef-1802174ef232 tempest-VolumesActionsTest-273308117 None] Created volume successfully. Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=107,cinder:INSERT=33,cinder:UPDATE=116,cinder:DELETE=11 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Flow 'volume_create_manager' (e5d721b0-dfb0-4d54-b535-3130a6d07527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d79e6de-4c05-4dfe-bc1b-01ffd8039fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d79e6de-4c05-4dfe-bc1b-01ffd8039fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198026898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a32d5e5-0383-461a-8e7d-d84bbe381fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fe60f72a0c4105a8584a603e31088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:52Z,use_quota=True,user_id='a49e96e4dba34dc79c89e899dcdcedb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e376b5-9ce8-44c5-8bb8-3be89c0dd38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e376b5-9ce8-44c5-8bb8-3be89c0dd38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688e4839-efea-4b17-922e-6709a2ff2b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688e4839-efea-4b17-922e-6709a2ff2b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a32d5e5-0383-461a-8e7d-d84bbe381fbf', 'volume_name': 'volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ac6212-b822-463e-b26f-1e2781aaec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ac6212-b822-463e-b26f-1e2781aaec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a24ff0-6564-4043-b17a-dd051f781802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Volume 3a32d5e5-0383-461a-8e7d-d84bbe381fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf', 'volume_size': 1} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198026898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a32d5e5-0383-461a-8e7d-d84bbe381fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fe60f72a0c4105a8584a603e31088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:52Z,use_quota=True,user_id='a49e96e4dba34dc79c89e899dcdcedb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Creating volume 3a32d5e5-0383-461a-8e7d-d84bbe381fbf {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:51 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:27:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:52 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf 1073741824 Nov 05 22:27:52 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:52 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf 1073741824" returned: 0 in 0.629s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:52 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf Nov 05 22:27:52 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:52 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf" returned: 0 in 0.314s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a24ff0-6564-4043-b17a-dd051f781802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db67cb32-b5f9-4b14-b835-424d73adb647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:53 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Volume volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf (3a32d5e5-0383-461a-8e7d-d84bbe381fbf): created successfully Nov 05 22:27:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db67cb32-b5f9-4b14-b835-424d73adb647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Flow 'volume_create_manager' (e5d721b0-dfb0-4d54-b535-3130a6d07527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-afcb2f3a-6032-44e2-baae-599a640af7f6 tempest-ProjectReaderTests-1058727228 None] Created volume successfully. Nov 05 22:27:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "cinder-3a32d5e5-0383-461a-8e7d-d84bbe381fbf-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-3a32d5e5-0383-461a-8e7d-d84bbe381fbf-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "cinder-quobyte-3a32d5e5-0383-461a-8e7d-d84bbe381fbf" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-quobyte-3a32d5e5-0383-461a-8e7d-d84bbe381fbf" acquired by "delete_volume" :: waited 0.057s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:27:54 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2da0d2-4a80-48ed-8da5-3e07981725aa]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:27:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:54 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf Nov 05 22:27:54 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:55 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf" returned: 0 in 0.741s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:55 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf Nov 05 22:27:55 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:55 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3a32d5e5-0383-461a-8e7d-d84bbe381fbf" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-quobyte-3a32d5e5-0383-461a-8e7d-d84bbe381fbf" released by "delete_volume" :: held 1.302s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Created reservations ['03019b1d-5ec7-4b8a-9d42-fcb4c3ddb09a', '9b7f160e-b928-40b7-905b-914c9a2356c0', '1bbbb297-9165-4af3-b742-f61de2414816', '35771831-1850-4b57-8470-507d9ddee952'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:55 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:27:55 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:56 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.359s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:56 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:27:56 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Deleted volume successfully. Nov 05 22:27:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-281ed9bc-ca0c-48a3-a3bd-483aea74e5a5 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-3a32d5e5-0383-461a-8e7d-d84bbe381fbf-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Flow 'volume_create_manager' (1965c2a9-dd8b-4001-8903-5746e141e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda7fe8f-156a-4226-be32-9023323ad090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda7fe8f-156a-4226-be32-9023323ad090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618563797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ab8b3d-51ad-468d-9a88-5313e6240924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fe60f72a0c4105a8584a603e31088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:57Z,use_quota=True,user_id='a49e96e4dba34dc79c89e899dcdcedb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d005c2c-8600-499a-b242-01bf19f5045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d005c2c-8600-499a-b242-01bf19f5045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7876ae-0016-4968-aed8-32e9bf01a506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7876ae-0016-4968-aed8-32e9bf01a506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9ab8b3d-51ad-468d-9a88-5313e6240924', 'volume_name': 'volume-c9ab8b3d-51ad-468d-9a88-5313e6240924', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31036350-852d-49db-ab18-f6bf53bd0385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31036350-852d-49db-ab18-f6bf53bd0385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb6bc2a-cd53-4b17-b929-805abb3f4e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:57 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Volume c9ab8b3d-51ad-468d-9a88-5313e6240924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9ab8b3d-51ad-468d-9a88-5313e6240924', 'volume_size': 1} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618563797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9ab8b3d-51ad-468d-9a88-5313e6240924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fe60f72a0c4105a8584a603e31088c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:27:57Z,use_quota=True,user_id='a49e96e4dba34dc79c89e899dcdcedb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Creating volume c9ab8b3d-51ad-468d-9a88-5313e6240924 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:27:57 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:27:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:57 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 1073741824 Nov 05 22:27:57 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:58 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 1073741824" returned: 0 in 0.699s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:27:58 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 Nov 05 22:27:58 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:27:59 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924" returned: 0 in 0.753s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb6bc2a-cd53-4b17-b929-805abb3f4e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9ab8b3d-51ad-468d-9a88-5313e6240924', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f7c3e0-93d3-49ad-99bb-11fe5c549174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:27:59 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Volume volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 (c9ab8b3d-51ad-468d-9a88-5313e6240924): created successfully Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f7c3e0-93d3-49ad-99bb-11fe5c549174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Flow 'volume_create_manager' (1965c2a9-dd8b-4001-8903-5746e141e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:27:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9e36176d-6a7b-4aba-875c-eaaeafe540a4 tempest-ProjectReaderTests-1058727228 None] Created volume successfully. Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "cinder-c9ab8b3d-51ad-468d-9a88-5313e6240924-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:27:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-c9ab8b3d-51ad-468d-9a88-5313e6240924-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "cinder-quobyte-c9ab8b3d-51ad-468d-9a88-5313e6240924" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-quobyte-c9ab8b3d-51ad-468d-9a88-5313e6240924" acquired by "delete_volume" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[407a45e7-7b5d-4440-a1d4-41d5d295c709]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:00 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 Nov 05 22:28:00 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:00 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924" returned: 0 in 0.773s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:01 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924 Nov 05 22:28:01 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:01 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c9ab8b3d-51ad-468d-9a88-5313e6240924" returned: 0 in 0.748s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-quobyte-c9ab8b3d-51ad-468d-9a88-5313e6240924" released by "delete_volume" :: held 1.645s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:01 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Created reservations ['45039688-4e71-4cf7-81db-c2b53a138b4d', '9b9c4927-440f-4e67-8260-9b9f12e18df1', '2c32c6a4-dc97-4f26-942d-2485d07e9c51', '98175ef6-f2fc-4f6e-a4fc-5da46e6313eb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:02 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:28:02 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b44662a8-99a2-41d0-b0ab-dc8c4bf7a8d0 tempest-VolumesActionsTest-273308117 None] Acquiring lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" by "attach_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b44662a8-99a2-41d0-b0ab-dc8c4bf7a8d0 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" acquired by "attach_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b44662a8-99a2-41d0-b0ab-dc8c4bf7a8d0 tempest-VolumesActionsTest-273308117 None] Attaching volume 640f0f40-e22d-4d9e-842d-eda73ff7cfc5 to instance d55f8129-8e16-4deb-8c3c-cc3cec3e0a8d at mountpoint /dev/vdb on host None. Nov 05 22:28:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b44662a8-99a2-41d0-b0ab-dc8c4bf7a8d0 tempest-VolumesActionsTest-273308117 None] Attach volume completed successfully. Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b44662a8-99a2-41d0-b0ab-dc8c4bf7a8d0 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" released by "attach_volume" :: held 0.189s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:02 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.737s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Deleted volume successfully. Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7490a2c1-9e08-4a04-b4d8-e865c964d146 tempest-ProjectReaderTests-1058727228 None] Lock "cinder-c9ab8b3d-51ad-468d-9a88-5313e6240924-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8054f352-b76b-4079-b3a4-c9bf0582b6d4 tempest-VolumesActionsTest-273308117 None] Acquiring lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-detach_volume" by "detach_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8054f352-b76b-4079-b3a4-c9bf0582b6d4 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8054f352-b76b-4079-b3a4-c9bf0582b6d4 tempest-VolumesActionsTest-273308117 None] Detaching volume 640f0f40-e22d-4d9e-842d-eda73ff7cfc5 from instance d55f8129-8e16-4deb-8c3c-cc3cec3e0a8d. Nov 05 22:28:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8054f352-b76b-4079-b3a4-c9bf0582b6d4 tempest-VolumesActionsTest-273308117 None] Detach volume completed successfully. Nov 05 22:28:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8054f352-b76b-4079-b3a4-c9bf0582b6d4 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-detach_volume" released by "detach_volume" :: held 0.178s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:13 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=63,cinder:DELETE=6,cinder:SELECT=58,cinder:INSERT=16 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:28:13 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:28:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6e4e1cf7-2705-4093-b751-dcaf850b2270 tempest-VolumesActionsTest-273308117 None] Acquiring lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" by "attach_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6e4e1cf7-2705-4093-b751-dcaf850b2270 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" acquired by "attach_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:17 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6e4e1cf7-2705-4093-b751-dcaf850b2270 tempest-VolumesActionsTest-273308117 None] Attaching volume 640f0f40-e22d-4d9e-842d-eda73ff7cfc5 to instance 032e107e-34fa-4314-b9f1-50ff52654bf6 at mountpoint /dev/vdb on host None. Nov 05 22:28:17 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6e4e1cf7-2705-4093-b751-dcaf850b2270 tempest-VolumesActionsTest-273308117 None] Attach volume completed successfully. Nov 05 22:28:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6e4e1cf7-2705-4093-b751-dcaf850b2270 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" released by "attach_volume" :: held 0.178s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-690ee972-dcb0-4243-ad45-3eb0b90f8604 tempest-VolumesActionsTest-273308117 None] Acquiring lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-detach_volume" by "detach_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-690ee972-dcb0-4243-ad45-3eb0b90f8604 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-690ee972-dcb0-4243-ad45-3eb0b90f8604 tempest-VolumesActionsTest-273308117 None] Detaching volume 640f0f40-e22d-4d9e-842d-eda73ff7cfc5 from instance 032e107e-34fa-4314-b9f1-50ff52654bf6. Nov 05 22:28:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-690ee972-dcb0-4243-ad45-3eb0b90f8604 tempest-VolumesActionsTest-273308117 None] Detach volume completed successfully. Nov 05 22:28:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-690ee972-dcb0-4243-ad45-3eb0b90f8604 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed73fe14-67a1-4e12-8cb1-d207a63d7eee]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:24 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:28:24 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:24 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.419s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[842a80cf-1e81-4770-a6a5-4fa62ce13ef3]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:24 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:28:24 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:25 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.365s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.85165d8d-048a-4bb4-9dac-fb6513cc92c98_gk7w1u.img {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:25 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.85165d8d-048a-4bb4-9dac-fb6513cc92c98_gk7w1u.img Nov 05 22:28:25 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:28 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:28:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2f6f4553-a36c-42f3-ac93-775984532ae9 tempest-TestShelveInstance-1268324992 None] Terminate volume connection completed successfully. Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2f6f4553-a36c-42f3-ac93-775984532ae9 tempest-TestShelveInstance-1268324992 None] Deleting attachment 68799738-fde8-409a-9eab-8368c5009311. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Acquiring lock "cinder-e7a0cfdb-7024-444d-abd3-63ee510f75e3-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Lock "cinder-e7a0cfdb-7024-444d-abd3-63ee510f75e3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Acquiring lock "cinder-quobyte-e7a0cfdb-7024-444d-abd3-63ee510f75e3" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Lock "cinder-quobyte-e7a0cfdb-7024-444d-abd3-63ee510f75e3" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ddb6fe-91c2-4c1a-8b17-51fc9e1ec441]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:33 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.85165d8d-048a-4bb4-9dac-fb6513cc92c98_gk7w1u.img" returned: 0 in 8.772s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b2061b-0b06-43a5-b044-9fc24a74e755]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:28:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:34 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 Nov 05 22:28:34 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:34 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:28:34 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:34 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3" returned: 0 in 0.622s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:34 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3 Nov 05 22:28:34 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:34 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.768s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5, size 1024.00 MB, duration 8.77 sec, destination /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.85165d8d-048a-4bb4-9dac-fb6513cc92c98_gk7w1u.img {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:28:34 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Converted 1024.00 MB image at 116.72 MB/s Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] 85165d8d-048a-4bb4-9dac-fb6513cc92c9 was raw, no need to convert to raw {{(pid=87085) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 22:28:34 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-e7a0cfdb-7024-444d-abd3-63ee510f75e3" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Lock "cinder-quobyte-e7a0cfdb-7024-444d-abd3-63ee510f75e3" released by "delete_volume" :: held 1.090s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:34 devstack cinder-volume[87085]: DEBUG cinder.quota [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Created reservations ['08ef675a-83b0-4153-94df-cb95c46a18d2', '53c83ee0-78f2-4981-ab7e-cb7cc4f25954', '89b3b571-fa84-4506-aa15-d177617d7968', '0bcd0381-5495-4cb2-a804-6a1aec1b28b9'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:35 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:28:35 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:35 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.320s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG cinder.manager [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Deleted volume successfully. Nov 05 22:28:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [req-7fd760b4-2da7-445a-8369-4ddff8e77409 req-2e63304e-2b06-43f4-9d31-39c828a06221 tempest-TestShelveInstance-1268324992 None] Lock "cinder-e7a0cfdb-7024-444d-abd3-63ee510f75e3-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Flow 'volume_create_manager' (19509689-1603-4c52-966c-83ecf74af9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979e9216-da63-411a-8941-354b24187a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979e9216-da63-411a-8941-354b24187a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-952163563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193521fe-5024-4340-9dd6-51ed34413c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c17ff8497643b7afe1b042278bd9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:37Z,use_quota=True,user_id='be3e7aae0c8f4aae98aaaf09ae15ead1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a28dbb-66d9-4df0-8b48-e2dfa44db3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a28dbb-66d9-4df0-8b48-e2dfa44db3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d6b4e7-f4e1-42c9-8276-69f1f2fbe406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d6b4e7-f4e1-42c9-8276-69f1f2fbe406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193521fe-5024-4340-9dd6-51ed34413c2c', 'volume_name': 'volume-193521fe-5024-4340-9dd6-51ed34413c2c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c76310-28fa-46d9-b886-054872eff579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c76310-28fa-46d9-b886-054872eff579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193738e7-f5c5-4fb0-b94c-24cad539ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Volume 193521fe-5024-4340-9dd6-51ed34413c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193521fe-5024-4340-9dd6-51ed34413c2c', 'volume_size': 1} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Flow 'volume_create_manager' (54bca61e-4ef7-4b20-b3f6-95b9828703db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fba3be-825c-4d35-a311-4e01fb0945a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fba3be-825c-4d35-a311-4e01fb0945a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1216802444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf1cab-ff74-421d-bdc3-ff62907aaa54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c17ff8497643b7afe1b042278bd9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:38Z,use_quota=True,user_id='be3e7aae0c8f4aae98aaaf09ae15ead1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b616437-ee07-4cf1-948e-98375c13fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b616437-ee07-4cf1-948e-98375c13fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf062df-737c-4942-8b26-7ba04e510c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf062df-737c-4942-8b26-7ba04e510c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fedf1cab-ff74-421d-bdc3-ff62907aaa54', 'volume_name': 'volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691a5a6a-c150-4bfa-a824-147cba648279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (691a5a6a-c150-4bfa-a824-147cba648279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7402738-e8f0-4f55-bb86-3b9d4f53d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:28:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Volume fedf1cab-ff74-421d-bdc3-ff62907aaa54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54', 'volume_size': 1} Nov 05 22:28:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:28:40 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:28:40 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:28:40 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.356s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:28:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:28:47 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=9,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:28:47 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.210s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Uploaded volume to glance image-id: 85165d8d-048a-4bb4-9dac-fb6513cc92c9. {{(pid=87085) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.364s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-952163563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193521fe-5024-4340-9dd6-51ed34413c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c17ff8497643b7afe1b042278bd9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:37Z,use_quota=True,user_id='be3e7aae0c8f4aae98aaaf09ae15ead1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Creating volume 193521fe-5024-4340-9dd6-51ed34413c2c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:02 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a4625a3d-4d90-419e-bd30-25d1dae84a74 tempest-VolumesActionsTest-273308117 None] Copy volume to image completed successfully. Nov 05 22:29:02 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c 1073741824 Nov 05 22:29:02 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:03 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c 1073741824" returned: 0 in 0.559s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:03 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c Nov 05 22:29:03 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:03 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.666s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1216802444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedf1cab-ff74-421d-bdc3-ff62907aaa54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c17ff8497643b7afe1b042278bd9ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:28:38Z,use_quota=True,user_id='be3e7aae0c8f4aae98aaaf09ae15ead1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Creating volume fedf1cab-ff74-421d-bdc3-ff62907aaa54 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:03 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:03 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 1073741824 Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193738e7-f5c5-4fb0-b94c-24cad539ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193521fe-5024-4340-9dd6-51ed34413c2c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:03 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f249eb-5b38-473b-95ca-dce516127a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:03 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Volume volume-193521fe-5024-4340-9dd6-51ed34413c2c (193521fe-5024-4340-9dd6-51ed34413c2c): created successfully Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f249eb-5b38-473b-95ca-dce516127a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Flow 'volume_create_manager' (19509689-1603-4c52-966c-83ecf74af9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-021c67da-64fd-4d85-95c8-1696d29505ff tempest-TestServerVolumeAttachmentScenario-579227515 None] Created volume successfully. Nov 05 22:29:04 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 1073741824" returned: 0 in 0.671s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:04 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 Nov 05 22:29:04 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:04 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7402738-e8f0-4f55-bb86-3b9d4f53d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cf7643-a323-46fc-9d25-9a70a9105942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:04 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Volume volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 (fedf1cab-ff74-421d-bdc3-ff62907aaa54): created successfully Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71cf7643-a323-46fc-9d25-9a70a9105942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Flow 'volume_create_manager' (54bca61e-4ef7-4b20-b3f6-95b9828703db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4152cd91-396e-4ab0-a166-ff44b4e59873 tempest-TestServerVolumeAttachmentScenario-579227515 None] Created volume successfully. Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e2322c-5e23-4f97-b66b-ef702196e839]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:05 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:29:05 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:05 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.365s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ed016-6bed-4233-b9d8-213c60bbf3a2]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:05 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:29:05 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:05 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.387s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:05 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img Nov 05 22:29:05 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:13 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img" returned: 0 in 7.755s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b5522-1dbc-493f-97dd-5fccdfe6f982]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:13 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:29:13 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-1bf5569f-b34c-49aa-bee2-cce214fc75b0 req-c3e390a4-06ba-4ea7-b00b-7b5443c047a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:14 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.582s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:29:14 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Converted 1024.00 MB image at 132.00 MB/s Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] edefa772-6e4e-422b-94f5-caf5efe4b4f1 was raw, converting to qcow2 {{(pid=87085) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad771e54-1027-4667-8872-236faed7383e]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:14 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img Nov 05 22:29:14 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:14 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img" returned: 0 in 0.328s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:14 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img Nov 05 22:29:14 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:14 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img" returned: 1 in 0.339s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img /opt/stack/data/cinder/conversion/vol_upload_k9fw3ft4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:14 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img /opt/stack/data/cinder/conversion/vol_upload_k9fw3ft4 Nov 05 22:29:14 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:14 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:29:15 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img /opt/stack/data/cinder/conversion/vol_upload_k9fw3ft4" returned: 0 in 0.277s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:15 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Image conversion details: src /opt/stack/data/cinder/conversion/640f0f40-e22d-4d9e-842d-eda73ff7cfc5.temp_image.edefa772-6e4e-422b-94f5-caf5efe4b4f1j8k6ud52.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_k9fw3ft4 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:29:15 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 22:29:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856192f-34ba-429e-9449-bc784c78a765]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k9fw3ft4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:15 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k9fw3ft4 Nov 05 22:29:15 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:15 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k9fw3ft4" returned: 0 in 0.333s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.911s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Uploaded volume to glance image-id: edefa772-6e4e-422b-94f5-caf5efe4b4f1. {{(pid=87085) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 22:29:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-1bf5569f-b34c-49aa-bee2-cce214fc75b0 req-c3e390a4-06ba-4ea7-b00b-7b5443c047a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-1bf5569f-b34c-49aa-bee2-cce214fc75b0 req-c3e390a4-06ba-4ea7-b00b-7b5443c047a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-dac8f76d-6734-4cfa-875a-3475dd385f66 tempest-VolumesActionsTest-273308117 None] Copy volume to image completed successfully. Nov 05 22:29:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-1bf5569f-b34c-49aa-bee2-cce214fc75b0 req-c3e390a4-06ba-4ea7-b00b-7b5443c047a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-193521fe-5024-4340-9dd6-51ed34413c2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ff0a775-46d0-4599-ab1d-e6a469fb8059', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:29:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-1bf5569f-b34c-49aa-bee2-cce214fc75b0 req-c3e390a4-06ba-4ea7-b00b-7b5443c047a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] attachment_update completed successfully. Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Acquiring lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Acquiring lock "cinder-quobyte-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Lock "cinder-quobyte-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd62e8ef-038f-434b-9651-7e52217e1350]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:18 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:29:18 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:18 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.435s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:18 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5 Nov 05 22:29:18 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:19 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" returned: 0 in 0.360s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Lock "cinder-quobyte-640f0f40-e22d-4d9e-842d-eda73ff7cfc5" released by "delete_volume" :: held 0.860s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Created reservations ['5880aa69-b6d8-4e5f-bd04-135d8c0d08de', '8b64bbb6-d9d3-48fb-8fcc-9a8af39188bf', '5594b7f8-46b3-4609-9220-52d07a2e998a', 'fe7db906-0870-4114-bcd9-9f1d042b026d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:19 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:19 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:19 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.298s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:19 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Deleted volume successfully. Nov 05 22:29:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b4b57acb-0ddc-46d9-bae7-17952935cf05 tempest-VolumesActionsTest-273308117 None] Lock "cinder-640f0f40-e22d-4d9e-842d-eda73ff7cfc5-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-f262e2a7-49f6-4908-ade5-fe37d7c7200b req-1185de97-2562-4d17-9b7a-0dda486e61a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-f262e2a7-49f6-4908-ade5-fe37d7c7200b req-1185de97-2562-4d17-9b7a-0dda486e61a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-f262e2a7-49f6-4908-ade5-fe37d7c7200b req-1185de97-2562-4d17-9b7a-0dda486e61a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:21 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-f262e2a7-49f6-4908-ade5-fe37d7c7200b req-1185de97-2562-4d17-9b7a-0dda486e61a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1a6d400-be12-4aba-83af-506a8c8e1766', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:29:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-f262e2a7-49f6-4908-ade5-fe37d7c7200b req-1185de97-2562-4d17-9b7a-0dda486e61a8 tempest-TestServerVolumeAttachmentScenario-579227515 None] attachment_update completed successfully. Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Flow 'volume_create_manager' (e2d5e30d-8125-47ff-ae77-948ce752ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbd875e-23c8-4f1f-803e-2d33d62ecb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbd875e-23c8-4f1f-803e-2d33d62ecb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-223878687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deab59fc-f6f2-4b74-8a1f-3cec391b8e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a8724d4406483cb7adb5e4d9afc446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:23Z,use_quota=True,user_id='d9c32011dfd141cd9cbfe9432312073c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607d6c6f-5763-4d7b-b5f6-4364d9009130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607d6c6f-5763-4d7b-b5f6-4364d9009130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffaaf0e-9016-443d-874a-18494cb5f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ffaaf0e-9016-443d-874a-18494cb5f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deab59fc-f6f2-4b74-8a1f-3cec391b8e1e', 'volume_name': 'volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a06253-f29c-4e0f-bc16-02d17d88e5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a06253-f29c-4e0f-bc16-02d17d88e5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566e2474-23ca-435a-9d2d-9b70b98e41cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:22 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Volume deab59fc-f6f2-4b74-8a1f-3cec391b8e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e', 'volume_size': 1} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-223878687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deab59fc-f6f2-4b74-8a1f-3cec391b8e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a8724d4406483cb7adb5e4d9afc446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:23Z,use_quota=True,user_id='d9c32011dfd141cd9cbfe9432312073c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Creating volume deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:22 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:22 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e 1073741824 Nov 05 22:29:22 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:23 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e 1073741824" returned: 0 in 0.610s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-ceb9af70-e74b-4556-9cc1-014c39420f8c req-939a0021-cd90-4a64-9728-9b59314cef85 tempest-TestServerVolumeAttachmentScenario-579227515 None] Terminate volume connection completed successfully. Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-ceb9af70-e74b-4556-9cc1-014c39420f8c req-939a0021-cd90-4a64-9728-9b59314cef85 tempest-TestServerVolumeAttachmentScenario-579227515 None] Deleting attachment f1a6d400-be12-4aba-83af-506a8c8e1766. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:23 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e Nov 05 22:29:23 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:23 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566e2474-23ca-435a-9d2d-9b70b98e41cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e3bfc9-f8e0-4e76-82a5-cdf9c35fc66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:23 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Volume volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e (deab59fc-f6f2-4b74-8a1f-3cec391b8e1e): created successfully Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e3bfc9-f8e0-4e76-82a5-cdf9c35fc66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Flow 'volume_create_manager' (e2d5e30d-8125-47ff-ae77-948ce752ceba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fb40c180-3c88-4d5f-b085-1c28a47606b4 tempest-TestStampPattern-1470570065 None] Created volume successfully. Nov 05 22:29:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-d4d6f180-8621-4095-8210-f6c2ce63c4b2 req-501947c5-a332-4bc3-9ff2-974b7aae2bab tempest-TestServerVolumeAttachmentScenario-579227515 None] Terminate volume connection completed successfully. Nov 05 22:29:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-d4d6f180-8621-4095-8210-f6c2ce63c4b2 req-501947c5-a332-4bc3-9ff2-974b7aae2bab tempest-TestServerVolumeAttachmentScenario-579227515 None] Deleting attachment 4ff0a775-46d0-4599-ab1d-e6a469fb8059. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "cinder-fedf1cab-ff74-421d-bdc3-ff62907aaa54-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-fedf1cab-ff74-421d-bdc3-ff62907aaa54-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "cinder-quobyte-fedf1cab-ff74-421d-bdc3-ff62907aaa54" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-quobyte-fedf1cab-ff74-421d-bdc3-ff62907aaa54" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[70281bc5-9f99-4427-a817-0d27918edecf]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:33 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 Nov 05 22:29:33 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:33 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54" returned: 0 in 0.491s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:33 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54 Nov 05 22:29:33 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:34 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fedf1cab-ff74-421d-bdc3-ff62907aaa54" returned: 0 in 0.308s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-quobyte-fedf1cab-ff74-421d-bdc3-ff62907aaa54" released by "delete_volume" :: held 0.871s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Created reservations ['4ed7ea43-0979-415d-b33c-82ff08119a9f', 'e4f2efe6-7dba-45ac-96c7-d502f086bc5b', '39bbfec8-588f-4103-9d7d-1e89a30c058b', '92814de5-53e3-48df-87ef-e46a17eab20b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:34 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:34 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "cinder-193521fe-5024-4340-9dd6-51ed34413c2c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-193521fe-5024-4340-9dd6-51ed34413c2c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "cinder-quobyte-193521fe-5024-4340-9dd6-51ed34413c2c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-quobyte-193521fe-5024-4340-9dd6-51ed34413c2c" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad56ba37-6bcd-43ae-af4f-76257608263d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:34 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.469s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:34 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Deleted volume successfully. Nov 05 22:29:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f567049c-ee5e-42ac-b8f3-85e846b0a0c0 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-fedf1cab-ff74-421d-bdc3-ff62907aaa54-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:34 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c Nov 05 22:29:34 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:35 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Flow 'volume_create_manager' (e2702e94-4d83-4271-8765-68cd05a1830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6605f80f-8dad-4a00-bce3-3cc49fcf9e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c" returned: 0 in 0.728s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:35 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c Nov 05 22:29:35 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6605f80f-8dad-4a00-bce3-3cc49fcf9e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-79490703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfac161-f83a-4ac3-8b66-2a4442be18d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fe852476fb446bad1b19020f09da91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:35Z,use_quota=True,user_id='4f21c3f2bb954c729b62a4f5a239a802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1ad497-c261-42ce-ada0-fa9b799bf63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1ad497-c261-42ce-ada0-fa9b799bf63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf7a8f2-1046-4ae8-8d37-a79b33484d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf7a8f2-1046-4ae8-8d37-a79b33484d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfac161-f83a-4ac3-8b66-2a4442be18d8', 'volume_name': 'volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8', 'volume_size': 2}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29c4fb6-b9eb-457f-876d-2025833f1518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29c4fb6-b9eb-457f-876d-2025833f1518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3063abb-3df8-4ca0-b33e-45b4d92383f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Volume 8dfac161-f83a-4ac3-8b66-2a4442be18d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8', 'volume_size': 2} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-79490703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfac161-f83a-4ac3-8b66-2a4442be18d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fe852476fb446bad1b19020f09da91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:35Z,use_quota=True,user_id='4f21c3f2bb954c729b62a4f5a239a802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Creating volume 8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:35 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 2147483648 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:35 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 2147483648 Nov 05 22:29:35 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:35 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-193521fe-5024-4340-9dd6-51ed34413c2c" returned: 0 in 0.428s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-quobyte-193521fe-5024-4340-9dd6-51ed34413c2c" released by "delete_volume" :: held 1.251s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Created reservations ['6783a100-3b55-4e1a-9672-85e75b7e7743', 'd1fc5068-a246-4d69-ba48-7c703ffb2f2e', '60c7bfb8-04ba-4472-ba10-86d33d516f18', '3ec40523-4545-4ce7-a892-3ed82b51631f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:36 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:36 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:36 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 2147483648" returned: 0 in 0.747s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:36 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 Nov 05 22:29:36 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:36 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.309s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Deleted volume successfully. Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0b69c2af-7db6-4bd7-b72c-50237ecb22e5 tempest-TestServerVolumeAttachmentScenario-579227515 None] Lock "cinder-193521fe-5024-4340-9dd6-51ed34413c2c-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:36 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3063abb-3df8-4ca0-b33e-45b4d92383f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8', 'volume_size': 2}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eefb1ee-367c-41a1-82a6-9522e40525d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:36 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Volume volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 (8dfac161-f83a-4ac3-8b66-2a4442be18d8): created successfully Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eefb1ee-367c-41a1-82a6-9522e40525d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Flow 'volume_create_manager' (e2702e94-4d83-4271-8765-68cd05a1830a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-386a4ac9-359f-4f81-988d-d6bf449823fa tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Created volume successfully. Nov 05 22:29:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Creating offline snapshot 0a930267-c2be-4b51-8e4b-e1c89fb12ac4 of volume 8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:29:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[71858602-fe5c-4a2f-a5d0-818a3144dc69]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:37 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 Nov 05 22:29:37 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:38 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8" returned: 0 in 0.399s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 2G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:38 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 2G Nov 05 22:29:38 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:38 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 2G" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:38 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 Nov 05 22:29:38 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:38 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4" returned: 0 in 0.305s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:38 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 is being set with open permissions: ugo+rw Nov 05 22:29:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:39 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 Nov 05 22:29:39 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:39 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4" returned: 0 in 0.267s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:39 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.info Nov 05 22:29:39 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:39 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.info" returned: 0 in 0.322s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:39 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.info is being set with open permissions: ugo+rw Nov 05 22:29:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:39 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.info Nov 05 22:29:39 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:39 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.info" returned: 0 in 0.250s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4d34ffc3-e600-455e-90cb-597467666e8e tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Create snapshot completed successfully Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:40 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:40 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:40 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.301s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:29:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "cinder-0a930267-c2be-4b51-8e4b-e1c89fb12ac4-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-0a930267-c2be-4b51-8e4b-e1c89fb12ac4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "cinder-quobyte-8dfac161-f83a-4ac3-8b66-2a4442be18d8" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-quobyte-8dfac161-f83a-4ac3-8b66-2a4442be18d8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "cinder-quobyte-0a930267-c2be-4b51-8e4b-e1c89fb12ac4" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-quobyte-0a930267-c2be-4b51-8e4b-e1c89fb12ac4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Deleting offline snapshot 0a930267-c2be-4b51-8e4b-e1c89fb12ac4 of volume 8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] snapshot_file for this snap is: volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[62900ce2-c453-45ed-a5ba-31120fffbd89]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:41 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 Nov 05 22:29:41 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:41 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4" returned: 0 in 0.425s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3ed761-ca20-4ad6-9d14-63031889f497]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:41 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 Nov 05 22:29:41 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:42 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8" returned: 0 in 0.469s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:42 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 Nov 05 22:29:42 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:42 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:42 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4 Nov 05 22:29:42 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:42 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8.0a930267-c2be-4b51-8e4b-e1c89fb12ac4" returned: 0 in 0.306s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-quobyte-0a930267-c2be-4b51-8e4b-e1c89fb12ac4" released by "_delete_snapshot" :: held 1.711s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-quobyte-8dfac161-f83a-4ac3-8b66-2a4442be18d8" released by "delete_snapshot" :: held 1.750s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Created reservations ['1fa2481d-f6e7-40da-a0cd-0b6af14362c8', '8caca4ab-fd35-41ee-9da3-76270955782d', 'ff6719e1-ee70-472a-b6c4-6d154ceac87d', '2db206fd-66a0-43bc-b400-c2e850940c6b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Delete snapshot completed successfully. Nov 05 22:29:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a8918d88-887d-4cf8-8d75-dc2eda8c9b27 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-0a930267-c2be-4b51-8e4b-e1c89fb12ac4-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "cinder-8dfac161-f83a-4ac3-8b66-2a4442be18d8-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-8dfac161-f83a-4ac3-8b66-2a4442be18d8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "cinder-quobyte-8dfac161-f83a-4ac3-8b66-2a4442be18d8" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-quobyte-8dfac161-f83a-4ac3-8b66-2a4442be18d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bf6ae6-0d20-49b7-829c-432ca395e42c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:43 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 Nov 05 22:29:43 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:43 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8" returned: 0 in 0.364s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:43 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8 Nov 05 22:29:43 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:44 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8dfac161-f83a-4ac3-8b66-2a4442be18d8" returned: 0 in 0.306s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-quobyte-8dfac161-f83a-4ac3-8b66-2a4442be18d8" released by "delete_volume" :: held 0.744s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Created reservations ['2c8f142f-9082-4df3-be3e-6af0a4893045', '4ae8b44d-9cd8-4290-bf47-45e447f26d71', 'acf9a252-1ec4-4b73-b146-ead4fe810183', 'f736e388-7722-409e-86b2-272513c2e31a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:44 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:44 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:44 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.309s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:44 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Deleted volume successfully. Nov 05 22:29:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-29b28096-e6a1-4fe8-9d95-572181044c66 tempest-VolumesSnapshotNegativeTestJSON-353199209 None] Lock "cinder-8dfac161-f83a-4ac3-8b66-2a4442be18d8-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (25dc14fe-152b-4ca5-a85d-ee85438a2a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d533711-959f-449a-b123-26b471a4d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d533711-959f-449a-b123-26b471a4d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-991940139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c0d098-8b59-4057-800a-41a75c05b792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:50Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5b9071-a9c3-40bb-9b0c-683e3bc69153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5b9071-a9c3-40bb-9b0c-683e3bc69153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea8d04f-9147-4f2e-899d-9bf37ca1ef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea8d04f-9147-4f2e-899d-9bf37ca1ef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c0d098-8b59-4057-800a-41a75c05b792', 'volume_name': 'volume-89c0d098-8b59-4057-800a-41a75c05b792', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12aa8005-d1e5-453e-8584-eace1d13b210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12aa8005-d1e5-453e-8584-eace1d13b210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0ff847-c8ca-4348-b576-f42f22f52a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Volume 89c0d098-8b59-4057-800a-41a75c05b792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c0d098-8b59-4057-800a-41a75c05b792', 'volume_size': 1} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-991940139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c0d098-8b59-4057-800a-41a75c05b792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:50Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Creating volume 89c0d098-8b59-4057-800a-41a75c05b792 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:49 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:49 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 1073741824 Nov 05 22:29:49 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (f904ae81-10f1-4ef2-8842-e7ed57135e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6d363e-6aca-44fe-8593-3a8f93c8741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6d363e-6aca-44fe-8593-3a8f93c8741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892500539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e16ddca-6886-4ca4-9b83-1b2152f2e17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:50Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226da76d-6044-4406-916e-adc95e74d04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226da76d-6044-4406-916e-adc95e74d04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddb770f-8f93-43e7-8379-9b04bf9f2ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddb770f-8f93-43e7-8379-9b04bf9f2ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e16ddca-6886-4ca4-9b83-1b2152f2e17c', 'volume_name': 'volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d08ec93-ad39-4163-8351-9b6b0d531b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d08ec93-ad39-4163-8351-9b6b0d531b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f9cf77-221a-4cc2-9c09-d8d57cdf3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:50 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Volume 2e16ddca-6886-4ca4-9b83-1b2152f2e17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c', 'volume_size': 1} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:50 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 1073741824" returned: 0 in 0.727s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:50 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 Nov 05 22:29:50 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:51 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892500539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e16ddca-6886-4ca4-9b83-1b2152f2e17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:50Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Creating volume 2e16ddca-6886-4ca4-9b83-1b2152f2e17c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:51 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:51 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c 1073741824 Nov 05 22:29:51 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca0ff847-c8ca-4348-b576-f42f22f52a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c0d098-8b59-4057-800a-41a75c05b792', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c2c49e-806e-4b1b-b977-01a4f0bf7847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (79325dd6-4665-4df7-b94c-af08dff3bb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496379e5-bae5-4722-8953-8c2c1511c659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Volume volume-89c0d098-8b59-4057-800a-41a75c05b792 (89c0d098-8b59-4057-800a-41a75c05b792): created successfully Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c2c49e-806e-4b1b-b977-01a4f0bf7847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (25dc14fe-152b-4ca5-a85d-ee85438a2a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496379e5-bae5-4722-8953-8c2c1511c659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1678136932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc560b7-ca29-47f1-9f77-f6ff2baa57cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:51Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbe0660-fe5e-4d5c-a412-a211f21f9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbe0660-fe5e-4d5c-a412-a211f21f9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d57ff13-a476-40d0-a0e6-c635fc9580d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d57ff13-a476-40d0-a0e6-c635fc9580d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc560b7-ca29-47f1-9f77-f6ff2baa57cc', 'volume_name': 'volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dca33b4-7928-41e6-92d9-9d2f87a4b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dca33b4-7928-41e6-92d9-9d2f87a4b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340daaf0-26d3-4832-b329-9d5a1fa2ef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Volume ccc560b7-ca29-47f1-9f77-f6ff2baa57cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc', 'volume_size': 1} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7823c8d2-347f-4d30-b526-7c9122740ec7 tempest-CreateVolumesFromImageTest-660647025 None] Created volume successfully. Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (b100ff43-5f33-4e08-be6a-0b626ca2dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345ae276-582e-47d1-9637-f01648b4e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345ae276-582e-47d1-9637-f01648b4e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028246847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6c5873-4ac2-4979-9d77-f007fce066f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:52Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fe7f0a-88a4-40f5-98c3-1180cabdaf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fe7f0a-88a4-40f5-98c3-1180cabdaf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:51 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce4c432-b916-452f-b81b-c42c2a3142d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce4c432-b916-452f-b81b-c42c2a3142d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6c5873-4ac2-4979-9d77-f007fce066f5', 'volume_name': 'volume-2f6c5873-4ac2-4979-9d77-f007fce066f5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3ddc29-6b98-469c-b4c0-ea4e0664f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3ddc29-6b98-469c-b4c0-ea4e0664f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59038ec-f12d-41fd-867c-f96247cb5571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Volume 2f6c5873-4ac2-4979-9d77-f007fce066f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6c5873-4ac2-4979-9d77-f007fce066f5', 'volume_size': 1} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c 1073741824" returned: 0 in 0.981s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:52 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c Nov 05 22:29:52 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:52 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.226s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1678136932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc560b7-ca29-47f1-9f77-f6ff2baa57cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:51Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Creating volume ccc560b7-ca29-47f1-9f77-f6ff2baa57cc {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:52 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:52 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc 1073741824 Nov 05 22:29:52 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f9cf77-221a-4cc2-9c09-d8d57cdf3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b5d18-0c22-4d03-ae65-45c05e591298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (4c2e18ef-1413-452b-bea0-9b7360bead5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9167a09-2379-4e56-a8eb-f0154687f360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9167a09-2379-4e56-a8eb-f0154687f360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-153965075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:52Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4f90e9-868b-438e-ba3b-d130562ef6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4f90e9-868b-438e-ba3b-d130562ef6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10505b6-7639-4d5b-88ed-0e1e51def576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10505b6-7639-4d5b-88ed-0e1e51def576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5', 'volume_name': 'volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1bfb32-c34d-40ec-8e48-894542988ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1bfb32-c34d-40ec-8e48-894542988ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e30460-6958-42b3-8e92-80d42cb317ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:52 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Volume 5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5', 'volume_size': 1} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:52 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Volume volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c (2e16ddca-6886-4ca4-9b83-1b2152f2e17c): created successfully Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7b5d18-0c22-4d03-ae65-45c05e591298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (f904ae81-10f1-4ef2-8842-e7ed57135e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:52 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b6698343-a7d5-46f6-8c93-16c61012d1a8 tempest-CreateVolumesFromImageTest-660647025 None] Created volume successfully. Nov 05 22:29:52 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc 1073741824" returned: 0 in 0.451s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:53 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc Nov 05 22:29:53 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:53 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc" returned: 0 in 0.250s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.216s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028246847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6c5873-4ac2-4979-9d77-f007fce066f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:52Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Creating volume 2f6c5873-4ac2-4979-9d77-f007fce066f5 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:53 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340daaf0-26d3-4832-b329-9d5a1fa2ef51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:53 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 1073741824 Nov 05 22:29:53 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b71780-13fa-4ef3-bb4e-0e801662837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:53 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Volume volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc (ccc560b7-ca29-47f1-9f77-f6ff2baa57cc): created successfully Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b71780-13fa-4ef3-bb4e-0e801662837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (79325dd6-4665-4df7-b94c-af08dff3bb07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-93607d57-b965-488f-bde2-87f9aac5c1ba tempest-CreateVolumesFromImageTest-660647025 None] Created volume successfully. Nov 05 22:29:53 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 1073741824" returned: 0 in 0.620s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:53 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 Nov 05 22:29:53 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:54 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-153965075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9631388e820a4e60bd51cc916e5af700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:29:52Z,use_quota=True,user_id='77d527ce926c4f47aa76afd0f31be9e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Creating volume 5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:29:54 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59038ec-f12d-41fd-867c-f96247cb5571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6c5873-4ac2-4979-9d77-f007fce066f5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:54 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 1073741824 Nov 05 22:29:54 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3b1c27-a4c0-4eed-a529-ee94ee174128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Volume volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 (2f6c5873-4ac2-4979-9d77-f007fce066f5): created successfully Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c3b1c27-a4c0-4eed-a529-ee94ee174128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (b100ff43-5f33-4e08-be6a-0b626ca2dea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-81ea5a21-0a01-42eb-a9e6-27d37c25fb1d tempest-CreateVolumesFromImageTest-660647025 None] Created volume successfully. Nov 05 22:29:54 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 1073741824" returned: 0 in 0.455s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:54 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 Nov 05 22:29:54 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:55 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5" returned: 0 in 0.272s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:29:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e30460-6958-42b3-8e92-80d42cb317ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a71838-a070-4642-b9e7-de991553cc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:29:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Volume volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 (5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5): created successfully Nov 05 22:29:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8a71838-a070-4642-b9e7-de991553cc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:29:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Flow 'volume_create_manager' (4c2e18ef-1413-452b-bea0-9b7360bead5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:29:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-acc7d4dc-a49d-4cc6-8b36-df5e7c5db0b0 tempest-CreateVolumesFromImageTest-660647025 None] Created volume successfully. Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-quobyte-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5" acquired by "delete_volume" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de36d13-1b86-4529-a6ee-2a74822bc86a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:56 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 Nov 05 22:29:56 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:56 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5" returned: 0 in 0.445s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:56 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5 Nov 05 22:29:56 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:56 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5" returned: 0 in 0.271s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5" released by "delete_volume" :: held 0.772s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Created reservations ['048e9c36-a4ac-4254-adf4-07601bb173fb', '4f0425bd-8fac-4fd1-be58-493e76294e53', '256de22b-a1d0-4aef-8aed-b86b142f8a4b', 'e39494ce-29a3-4fd4-a170-1a183da2bbee'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:57 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:57 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-2f6c5873-4ac2-4979-9d77-f007fce066f5-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-2f6c5873-4ac2-4979-9d77-f007fce066f5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-quobyte-2f6c5873-4ac2-4979-9d77-f007fce066f5" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-2f6c5873-4ac2-4979-9d77-f007fce066f5" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0dd2a6-a070-4351-a1bf-b2007afb890a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:57 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Deleted volume successfully. Nov 05 22:29:57 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 Nov 05 22:29:57 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-49d86545-51db-4864-a9d9-1f63934d7e07 req-197829bc-35e9-4e49-8d0d-a1442314b5be tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-49d86545-51db-4864-a9d9-1f63934d7e07 req-197829bc-35e9-4e49-8d0d-a1442314b5be tempest-TestStampPattern-1470570065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a6ab549b-e5da-4187-8b3e-02b7e53995d4 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-5a8f9c3b-0612-433a-8f2b-466ff2ec3ca5-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-49d86545-51db-4864-a9d9-1f63934d7e07 req-197829bc-35e9-4e49-8d0d-a1442314b5be tempest-TestStampPattern-1470570065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-49d86545-51db-4864-a9d9-1f63934d7e07 req-197829bc-35e9-4e49-8d0d-a1442314b5be tempest-TestStampPattern-1470570065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd0634b1-b2ac-41cf-997f-2958555c4021', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=84,cinder:INSERT=24,cinder:UPDATE=79,cinder:DELETE=9 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:29:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-49d86545-51db-4864-a9d9-1f63934d7e07 req-197829bc-35e9-4e49-8d0d-a1442314b5be tempest-TestStampPattern-1470570065 None] attachment_update completed successfully. Nov 05 22:29:57 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5" returned: 0 in 0.492s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:57 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5 Nov 05 22:29:57 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:58 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2f6c5873-4ac2-4979-9d77-f007fce066f5" returned: 0 in 0.369s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-2f6c5873-4ac2-4979-9d77-f007fce066f5" released by "delete_volume" :: held 0.930s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Created reservations ['6b7b4b14-473c-4ed3-8edb-bfd4abe438a6', 'd1839298-7578-4881-a594-be5583324941', '86e35627-2a6d-4f5e-b678-5fe7d7d30b5b', 'eef155c1-8a56-4933-b4f6-4147edca1c4a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:58 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:58 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-quobyte-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb11332-8315-4d22-8945-9252847bd4c8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:58 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc Nov 05 22:29:58 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:58 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.441s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:29:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Deleted volume successfully. Nov 05 22:29:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cdc34530-fc5c-414a-a172-db71c0a1a880 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-2f6c5873-4ac2-4979-9d77-f007fce066f5-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:59 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc" returned: 0 in 0.477s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:59 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc Nov 05 22:29:59 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:59 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc" returned: 0 in 0.279s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc" released by "delete_volume" :: held 0.835s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Created reservations ['4a5ac0fa-fc14-4458-92f4-6005e5b1f54f', '5628221e-b80e-4bf1-83e8-5439cb1e022d', '9fd137a0-45fa-4e6a-96c8-ec19747f0747', '401244c7-b6d0-4b1b-83a4-880be6c1c4d0'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:29:59 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:29:59 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-2e16ddca-6886-4ca4-9b83-1b2152f2e17c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:29:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-2e16ddca-6886-4ca4-9b83-1b2152f2e17c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-quobyte-2e16ddca-6886-4ca4-9b83-1b2152f2e17c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-2e16ddca-6886-4ca4-9b83-1b2152f2e17c" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b058f2-c449-4d08-8717-024f7b878c60]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:00 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.441s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Deleted volume successfully. Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f2b2fe88-95a0-406a-9b3b-d4972db9deb6 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-ccc560b7-ca29-47f1-9f77-f6ff2baa57cc-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:00 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c Nov 05 22:30:00 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:00 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c" returned: 0 in 0.498s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:00 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c Nov 05 22:30:00 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:00 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2e16ddca-6886-4ca4-9b83-1b2152f2e17c" returned: 0 in 0.322s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-2e16ddca-6886-4ca4-9b83-1b2152f2e17c" released by "delete_volume" :: held 0.884s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:00 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Created reservations ['906b150e-8359-4b4f-982d-0cff1cdd4eb6', '22cb2371-40de-4bef-86c6-c929361d79b1', '0dc00c28-d92c-4028-8be2-a3457241c2a3', 'f6da96a8-7a16-4ee9-96a0-1442da15a8a1'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:01 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:30:01 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-89c0d098-8b59-4057-800a-41a75c05b792-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-89c0d098-8b59-4057-800a-41a75c05b792-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "cinder-quobyte-89c0d098-8b59-4057-800a-41a75c05b792" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-89c0d098-8b59-4057-800a-41a75c05b792" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0907a47e-0045-4168-b140-36a5abbc0bea]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:01 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 Nov 05 22:30:01 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:01 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.383s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Deleted volume successfully. Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed630f-ffff-4c06-b1dd-3bccc5743098 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-2e16ddca-6886-4ca4-9b83-1b2152f2e17c-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:01 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792" returned: 0 in 0.489s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:01 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792 Nov 05 22:30:01 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:02 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-89c0d098-8b59-4057-800a-41a75c05b792" returned: 0 in 0.335s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-quobyte-89c0d098-8b59-4057-800a-41a75c05b792" released by "delete_volume" :: held 0.891s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Created reservations ['7e4d2066-763a-4f1b-b5df-29a11945beec', '117196db-5cc1-4be2-a442-dfa62ee0779a', '908c3e75-792d-4b3c-8ba0-de57b9f475bb', '8e941bfb-0ef4-4769-9a21-ac4947d69282'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:02 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:30:02 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:02 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Deleted volume successfully. Nov 05 22:30:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e600a0a1-eb79-4d60-bc16-a11136fbdd77 tempest-CreateVolumesFromImageTest-660647025 None] Lock "cinder-89c0d098-8b59-4057-800a-41a75c05b792-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-0c3f4a5d-320a-4214-8629-49921a255e17 req-132dda50-2b9d-4f57-8f6d-18898132a2c5 tempest-TestStampPattern-1470570065 None] Terminate volume connection completed successfully. Nov 05 22:30:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-0c3f4a5d-320a-4214-8629-49921a255e17 req-132dda50-2b9d-4f57-8f6d-18898132a2c5 tempest-TestStampPattern-1470570065 None] Deleting attachment bd0634b1-b2ac-41cf-997f-2958555c4021. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:30:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Creating offline snapshot dcba029e-9102-4c4b-891c-c658f2dfcdb1 of volume deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:30:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d17948-ef78-4eea-a4f2-93bfdbd084ef]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:04 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e Nov 05 22:30:04 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:04 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" returned: 0 in 0.401s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:05 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 1G Nov 05 22:30:05 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:05 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 1G" returned: 0 in 0.530s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:05 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 Nov 05 22:30:05 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:05 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1" returned: 0 in 0.320s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:05 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 is being set with open permissions: ugo+rw Nov 05 22:30:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:05 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 Nov 05 22:30:05 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:06 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1" returned: 0 in 0.268s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:06 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.info Nov 05 22:30:06 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:06 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.info" returned: 0 in 0.284s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:06 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.info is being set with open permissions: ugo+rw Nov 05 22:30:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:06 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.info Nov 05 22:30:06 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:06 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.info" returned: 0 in 0.356s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-66e311d8-2a63-4ba4-b736-1e248ed83333 tempest-TestStampPattern-1470570065 None] Create snapshot completed successfully Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Flow 'volume_create_manager' (dd703556-aa03-40bc-8f2e-33d4b5e79a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914ff146-2031-4e3f-a8ed-3f0b5c52f9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914ff146-2031-4e3f-a8ed-3f0b5c52f9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e25555-696f-4ff2-8799-703ef70d09ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273af9fccbbb4e7f95fc45c0ed392f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:09Z,use_quota=True,user_id='e75a90e60bf64c619832805649f93e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d007d73f-31f1-436b-8888-7e6845772f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d007d73f-31f1-436b-8888-7e6845772f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dde9570-9b57-489e-80c9-f54717aee4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:08 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dde9570-9b57-489e-80c9-f54717aee4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7e25555-696f-4ff2-8799-703ef70d09ff', 'volume_name': 'volume-b7e25555-696f-4ff2-8799-703ef70d09ff', 'volume_size': 1, 'image_id': 'e85e31a0-ca4e-4e66-85f0-9a9590330209', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e85e31a0-ca4e-4e66-85f0-9a9590330209', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '282755ad07cef488f7650a25e81fc06d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '273af9fccbbb4e7f95fc45c0ed392f5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76cde9958868ed2bfb21aeff049634f77ebbb7279c95e609232ef34b60a3e5c9a21f3c6eaaa63bd353deffa6a78aa1ad32c6bd5f137cbace2c9aa6556bb166b9', 'id': 'e85e31a0-ca4e-4e66-85f0-9a9590330209', 'created_at': datetime.datetime(2026, 11, 5, 21, 30, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 30, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e85e31a0-ca4e-4e66-85f0-9a9590330209/file', 'properties': {}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa70972d-6b81-4b24-99e5-0f589ae09bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa70972d-6b81-4b24-99e5-0f589ae09bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c7fdba-7350-45df-a16f-310171e4de21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:09 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Volume b7e25555-696f-4ff2-8799-703ef70d09ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7e25555-696f-4ff2-8799-703ef70d09ff', 'volume_size': 1, 'image_id': 'e85e31a0-ca4e-4e66-85f0-9a9590330209', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e85e31a0-ca4e-4e66-85f0-9a9590330209', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '282755ad07cef488f7650a25e81fc06d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '273af9fccbbb4e7f95fc45c0ed392f5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76cde9958868ed2bfb21aeff049634f77ebbb7279c95e609232ef34b60a3e5c9a21f3c6eaaa63bd353deffa6a78aa1ad32c6bd5f137cbace2c9aa6556bb166b9', 'id': 'e85e31a0-ca4e-4e66-85f0-9a9590330209', 'created_at': datetime.datetime(2026, 11, 5, 21, 30, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 30, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e85e31a0-ca4e-4e66-85f0-9a9590330209/file', 'properties': {}}, 'image_service': } Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Trying to clone b7e25555-696f-4ff2-8799-703ef70d09ff from image e85e31a0-ca4e-4e66-85f0-9a9590330209 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e85e31a0-ca4e-4e66-85f0-9a9590330209', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:30:09 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[11655457-2064-4953-a31d-188ab6519a2b]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:09 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD Nov 05 22:30:09 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:09 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:09 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD Nov 05 22:30:09 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:10 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:30:10 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Temporary image e85e31a0-ca4e-4e66-85f0-9a9590330209 is fetched for user e75a90e60bf64c619832805649f93e81. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:30:10 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5c958f-526a-4156-9a1b-97b677e824a1]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:10 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD Nov 05 22:30:10 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:10 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:10 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD Nov 05 22:30:10 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:11 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e25555-696f-4ff2-8799-703ef70d09ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273af9fccbbb4e7f95fc45c0ed392f5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:09Z,use_quota=True,user_id='e75a90e60bf64c619832805649f93e81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Creating volume b7e25555-696f-4ff2-8799-703ef70d09ff {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:30:11 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:11 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff 1073741824 Nov 05 22:30:11 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:11 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff 1073741824" returned: 0 in 0.617s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:11 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff Nov 05 22:30:11 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:12 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Attempting download of e85e31a0-ca4e-4e66-85f0-9a9590330209 ((None, [{'url': 'file:///opt/stack/data/glance/images/e85e31a0-ca4e-4e66-85f0-9a9590330209', 'metadata': {}}])) to volume b7e25555-696f-4ff2-8799-703ef70d09ff. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6730e0ac-b2a5-4aeb-8601-4970e9c21289]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e85e31a0-ca4e-4e66-85f0-9a9590330209_0br5h6s3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:12 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e85e31a0-ca4e-4e66-85f0-9a9590330209_0br5h6s3 Nov 05 22:30:12 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:12 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e85e31a0-ca4e-4e66-85f0-9a9590330209_0br5h6s3" returned: 0 in 0.333s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e85e31a0-ca4e-4e66-85f0-9a9590330209_0br5h6s3 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:12 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e85e31a0-ca4e-4e66-85f0-9a9590330209_0br5h6s3 Nov 05 22:30:12 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Flow 'volume_create_manager' (6036a643-6df4-421d-bfb9-843f2dc33b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d957eb1-c24c-4768-a6e7-d5bb15955276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d957eb1-c24c-4768-a6e7-d5bb15955276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-346494495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37739193-8dc4-44e2-abdb-130f7f4c73e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766ddf445a58432e9b20d7099075aa94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:13Z,use_quota=True,user_id='dd5a1898414445c1af4955a3fca4a345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff286d-0879-405b-b763-caf7facd66a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff286d-0879-405b-b763-caf7facd66a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713464c9-d04a-4dcb-ae10-29f0aeb20733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713464c9-d04a-4dcb-ae10-29f0aeb20733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37739193-8dc4-44e2-abdb-130f7f4c73e8', 'volume_name': 'volume-37739193-8dc4-44e2-abdb-130f7f4c73e8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d986e8d9-c29f-49c4-b3bc-369b306fcdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:12 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d986e8d9-c29f-49c4-b3bc-369b306fcdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abc1540-3e18-4784-bf7e-51e3af11e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Volume 37739193-8dc4-44e2-abdb-130f7f4c73e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37739193-8dc4-44e2-abdb-130f7f4c73e8', 'volume_size': 1} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-346494495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37739193-8dc4-44e2-abdb-130f7f4c73e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766ddf445a58432e9b20d7099075aa94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:13Z,use_quota=True,user_id='dd5a1898414445c1af4955a3fca4a345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Creating volume 37739193-8dc4-44e2-abdb-130f7f4c73e8 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:30:12 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e85e31a0-ca4e-4e66-85f0-9a9590330209_0br5h6s3" returned: 1 in 0.394s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e85e31a0-ca4e-4e66-85f0-9a9590330209_0br5h6s3' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af80b41-4970-4e6a-975f-f7bdd675e53a]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:13 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 1073741824 Nov 05 22:30:13 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:13 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD Nov 05 22:30:13 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:13 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:13 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 1073741824" returned: 0 in 0.505s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:13 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD Nov 05 22:30:13 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:13 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 Nov 05 22:30:13 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:13 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] e85e31a0-ca4e-4e66-85f0-9a9590330209 was raw, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:13 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff Nov 05 22:30:13 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:13 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8" returned: 0 in 0.300s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6abc1540-3e18-4784-bf7e-51e3af11e849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37739193-8dc4-44e2-abdb-130f7f4c73e8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd443931-73b8-46ee-9839-f719e801a391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Volume volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 (37739193-8dc4-44e2-abdb-130f7f4c73e8): created successfully Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd443931-73b8-46ee-9839-f719e801a391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Flow 'volume_create_manager' (6036a643-6df4-421d-bfb9-843f2dc33b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2cd57a37-7fa2-45c8-8bd4-76eccbfc77b7 tempest-TestImageHashVerification-895672038 None] Created volume successfully. Nov 05 22:30:14 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff" returned: 0 in 0.512s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e85e31a0-ca4e-4e66-85f0-9a9590330209_hvmvdjw9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:30:14 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:14 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff 1G Nov 05 22:30:14 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:14 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff 1G" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Downloaded image e85e31a0-ca4e-4e66-85f0-9a9590330209 ((None, [{'url': 'file:///opt/stack/data/glance/images/e85e31a0-ca4e-4e66-85f0-9a9590330209', 'metadata': {}}])) to volume b7e25555-696f-4ff2-8799-703ef70d09ff successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Temporary image e85e31a0-ca4e-4e66-85f0-9a9590330209 for user e75a90e60bf64c619832805649f93e81 is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Marking volume b7e25555-696f-4ff2-8799-703ef70d09ff as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Copying metadata from image e85e31a0-ca4e-4e66-85f0-9a9590330209 to b7e25555-696f-4ff2-8799-703ef70d09ff. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Creating volume glance metadata for volume b7e25555-696f-4ff2-8799-703ef70d09ff backed by image e85e31a0-ca4e-4e66-85f0-9a9590330209 with: {'image_id': 'e85e31a0-ca4e-4e66-85f0-9a9590330209', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '282755ad07cef488f7650a25e81fc06d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c7fdba-7350-45df-a16f-310171e4de21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e25555-696f-4ff2-8799-703ef70d09ff', 'volume_size': 1, 'image_id': 'e85e31a0-ca4e-4e66-85f0-9a9590330209', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e85e31a0-ca4e-4e66-85f0-9a9590330209', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '282755ad07cef488f7650a25e81fc06d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '273af9fccbbb4e7f95fc45c0ed392f5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76cde9958868ed2bfb21aeff049634f77ebbb7279c95e609232ef34b60a3e5c9a21f3c6eaaa63bd353deffa6a78aa1ad32c6bd5f137cbace2c9aa6556bb166b9', 'id': 'e85e31a0-ca4e-4e66-85f0-9a9590330209', 'created_at': datetime.datetime(2026, 11, 5, 21, 30, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 30, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e85e31a0-ca4e-4e66-85f0-9a9590330209/file', 'properties': {}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c91295f-27c8-4518-8cd9-0c85c1b5d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:14 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Volume volume-b7e25555-696f-4ff2-8799-703ef70d09ff (b7e25555-696f-4ff2-8799-703ef70d09ff): created successfully Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c91295f-27c8-4518-8cd9-0c85c1b5d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Flow 'volume_create_manager' (dd703556-aa03-40bc-8f2e-33d4b5e79a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:14 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b023fc1e-4654-4a9a-9b9f-e61c077e1e6c tempest-VolumeImageDependencyTests-1659162817 None] Created volume successfully. Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Acquiring lock "cinder-b7e25555-696f-4ff2-8799-703ef70d09ff-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Lock "cinder-b7e25555-696f-4ff2-8799-703ef70d09ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=113,cinder:SELECT=102,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Acquiring lock "cinder-quobyte-b7e25555-696f-4ff2-8799-703ef70d09ff" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Lock "cinder-quobyte-b7e25555-696f-4ff2-8799-703ef70d09ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb14f9-09e5-45a6-8686-5af2db84efe7]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:15 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff Nov 05 22:30:15 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:15 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff" returned: 0 in 0.397s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:15 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff Nov 05 22:30:15 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e775aa-5b07-424d-9127-7263d6a9577f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:15 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 Nov 05 22:30:15 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:30:16 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b7e25555-696f-4ff2-8799-703ef70d09ff" returned: 0 in 0.340s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Flow 'volume_create_manager' (f3235b1e-8167-43cd-b0a4-41309c18c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62aa0d62-4038-4019-ab68-bf81bc0e22b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Lock "cinder-quobyte-b7e25555-696f-4ff2-8799-703ef70d09ff" released by "delete_volume" :: held 0.827s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62aa0d62-4038-4019-ab68-bf81bc0e22b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1774024866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdd478b-493e-4934-9104-1f46c3a7bab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a8724d4406483cb7adb5e4d9afc446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dcba029e-9102-4c4b-891c-c658f2dfcdb1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:30:16Z,use_quota=True,user_id='d9c32011dfd141cd9cbfe9432312073c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e04dc-99b3-480e-8714-1ee29cd800b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e04dc-99b3-480e-8714-1ee29cd800b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc905e2d-0fee-42e1-9f26-78d35b13420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc905e2d-0fee-42e1-9f26-78d35b13420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1cdd478b-493e-4934-9104-1f46c3a7bab1', 'volume_name': 'volume-1cdd478b-493e-4934-9104-1f46c3a7bab1', 'volume_size': 1, 'snapshot_id': 'dcba029e-9102-4c4b-891c-c658f2dfcdb1'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be18e17-de61-47a5-8e6e-1ab1dabb54ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be18e17-de61-47a5-8e6e-1ab1dabb54ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdc38aa-5cb0-4795-81c2-1294f64d8885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:16 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Volume 1cdd478b-493e-4934-9104-1f46c3a7bab1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1cdd478b-493e-4934-9104-1f46c3a7bab1', 'volume_size': 1, 'snapshot_id': 'dcba029e-9102-4c4b-891c-c658f2dfcdb1'} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Created reservations ['9cf5f3d5-0695-4ae1-a1b2-9a1f96c02359', 'c4dce933-091e-44ac-9ec0-dd1d294d4bad', '844ae630-3455-4865-8636-fe78f8f83fd9', '6bc94449-847c-4ff5-84e4-ecce83f1a98d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:30:16 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8" returned: 0 in 0.479s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35b9d6-c85d-43a8-a70b-c1300d2ef23d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:16 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:30:16 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:16 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 Nov 05 22:30:16 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:16 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.290s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Deleted volume successfully. Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-88c9f831-e849-42c2-98b7-cdaa5a97627b tempest-VolumeImageDependencyTests-1659162817 None] Lock "cinder-b7e25555-696f-4ff2-8799-703ef70d09ff-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:16 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 /opt/stack/data/cinder/conversion/37739193-8dc4-44e2-abdb-130f7f4c73e8.temp_image.2f549feb-a698-4861-9faa-752c512c219alydzkhio.img {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:16 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 /opt/stack/data/cinder/conversion/37739193-8dc4-44e2-abdb-130f7f4c73e8.temp_image.2f549feb-a698-4861-9faa-752c512c219alydzkhio.img Nov 05 22:30:16 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 /opt/stack/data/cinder/conversion/37739193-8dc4-44e2-abdb-130f7f4c73e8.temp_image.2f549feb-a698-4861-9faa-752c512c219alydzkhio.img" returned: 0 in 8.575s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:25 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8a373-32e8-4830-b644-bb6cd81de814]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:25 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 Nov 05 22:30:25 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:26 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=36,cinder:INSERT=15,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:30:26 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8" returned: 0 in 1.010s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:26 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/conversion/37739193-8dc4-44e2-abdb-130f7f4c73e8.temp_image.2f549feb-a698-4861-9faa-752c512c219alydzkhio.img {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:30:26 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Converted 1024.00 MB image at 119.40 MB/s Nov 05 22:30:26 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] 2f549feb-a698-4861-9faa-752c512c219a was raw, no need to convert to raw {{(pid=87085) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 22:30:36 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:30:36 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:40 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:30:40 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:40 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.260s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:30:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.674s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Uploaded volume to glance image-id: 2f549feb-a698-4861-9faa-752c512c219a. {{(pid=87085) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 30.232s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-quobyte-dcba029e-9102-4c4b-891c-c658f2dfcdb1-1cdd478b-493e-4934-9104-1f46c3a7bab1" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:46 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6c48cdb9-9f51-471f-bb1a-0818ef605837 tempest-TestImageHashVerification-895672038 None] Copy volume to image completed successfully. Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-dcba029e-9102-4c4b-891c-c658f2dfcdb1-1cdd478b-493e-4934-9104-1f46c3a7bab1" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Creating volume 1cdd478b-493e-4934-9104-1f46c3a7bab1 from snapshot dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-quobyte-1cdd478b-493e-4934-9104-1f46c3a7bab1" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-1cdd478b-493e-4934-9104-1f46c3a7bab1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] snapshot: dcba029e-9102-4c4b-891c-c658f2dfcdb1, volume: 1cdd478b-493e-4934-9104-1f46c3a7bab1, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb535661-75a0-4e00-bf9c-d084e1ddf093]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:46 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 Nov 05 22:30:46 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:46 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1" returned: 0 in 0.372s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fa2f68-8015-4650-b41b-4537a280bc2a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:47 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e Nov 05 22:30:47 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:47 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" returned: 0 in 0.389s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:47 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 Nov 05 22:30:47 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Acquiring lock "cinder-37739193-8dc4-44e2-abdb-130f7f4c73e8-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Lock "cinder-37739193-8dc4-44e2-abdb-130f7f4c73e8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Acquiring lock "cinder-quobyte-37739193-8dc4-44e2-abdb-130f7f4c73e8" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Lock "cinder-quobyte-37739193-8dc4-44e2-abdb-130f7f4c73e8" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f796df-ef73-4e33-b203-9538416b6499]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:30:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:48 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 Nov 05 22:30:48 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:48 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8" returned: 0 in 0.567s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:48 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8 Nov 05 22:30:48 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:48 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-37739193-8dc4-44e2-abdb-130f7f4c73e8" returned: 0 in 0.348s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Lock "cinder-quobyte-37739193-8dc4-44e2-abdb-130f7f4c73e8" released by "delete_volume" :: held 0.977s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:48 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Created reservations ['78ee0fc4-05cf-43cd-a744-591a6c7cda46', '8cfdbc4e-6cad-4155-b486-478e165fba96', '7f71b25f-223f-407e-8274-1ff9f6192cf8', 'ff716955-1753-4adb-bd6c-e09fad4d2184'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:49 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:30:49 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:49 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.310s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:30:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Deleted volume successfully. Nov 05 22:30:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4a2426e8-f9e0-42fa-b354-a07a479707d3 tempest-TestImageHashVerification-895672038 None] Lock "cinder-37739193-8dc4-44e2-abdb-130f7f4c73e8-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:55 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1" returned: 0 in 7.735s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:30:55 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Converted 1024.00 MB image at 132.37 MB/s Nov 05 22:30:55 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 is being set with open permissions: ugo+rw Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:30:55 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 Nov 05 22:30:55 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:30:55 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1" returned: 0 in 0.255s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-1cdd478b-493e-4934-9104-1f46c3a7bab1" released by "_copy_volume_from_snapshot" :: held 8.841s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-dcba029e-9102-4c4b-891c-c658f2dfcdb1-1cdd478b-493e-4934-9104-1f46c3a7bab1" released by "_create_volume_from_snapshot" :: held 8.921s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.947s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdc38aa-5cb0-4795-81c2-1294f64d8885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdd478b-493e-4934-9104-1f46c3a7bab1', 'volume_size': 1, 'snapshot_id': 'dcba029e-9102-4c4b-891c-c658f2dfcdb1'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87f6da5-0155-427b-84e6-8ba295e0bf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:30:55 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Volume volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 (1cdd478b-493e-4934-9104-1f46c3a7bab1): created successfully Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87f6da5-0155-427b-84e6-8ba295e0bf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:30:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Flow 'volume_create_manager' (f3235b1e-8167-43cd-b0a4-41309c18c03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:30:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-85dd5a9e-fc1a-4aeb-ab93-3d6c82de60ea tempest-TestStampPattern-1470570065 None] Created volume successfully. Nov 05 22:30:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-db7afdd6-b019-4240-b546-5e3655d8338d req-a124edf2-0a66-4d1b-bd6b-1e973c5ac44b tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:30:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-db7afdd6-b019-4240-b546-5e3655d8338d req-a124edf2-0a66-4d1b-bd6b-1e973c5ac44b tempest-TestStampPattern-1470570065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:30:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [req-db7afdd6-b019-4240-b546-5e3655d8338d req-a124edf2-0a66-4d1b-bd6b-1e973c5ac44b tempest-TestStampPattern-1470570065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:30:56 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-db7afdd6-b019-4240-b546-5e3655d8338d req-a124edf2-0a66-4d1b-bd6b-1e973c5ac44b tempest-TestStampPattern-1470570065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140', 'name': 'volume-1cdd478b-493e-4934-9104-1f46c3a7bab1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cca5d725-e189-46d1-8557-99cda69edfef', 'enforce_multipath': True} {{(pid=87085) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 22:30:56 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-db7afdd6-b019-4240-b546-5e3655d8338d req-a124edf2-0a66-4d1b-bd6b-1e973c5ac44b tempest-TestStampPattern-1470570065 None] attachment_update completed successfully. Nov 05 22:31:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [req-92c185fd-8341-45aa-96f3-d240b22932f7 req-6e540f3f-e671-4262-8a7b-2a6849197747 tempest-TestStampPattern-1470570065 None] Terminate volume connection completed successfully. Nov 05 22:31:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [req-92c185fd-8341-45aa-96f3-d240b22932f7 req-6e540f3f-e671-4262-8a7b-2a6849197747 tempest-TestStampPattern-1470570065 None] Deleting attachment cca5d725-e189-46d1-8557-99cda69edfef. {{(pid=87085) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 22:31:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-1cdd478b-493e-4934-9104-1f46c3a7bab1-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Lock "cinder-1cdd478b-493e-4934-9104-1f46c3a7bab1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-quobyte-1cdd478b-493e-4934-9104-1f46c3a7bab1" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-1cdd478b-493e-4934-9104-1f46c3a7bab1" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d3f36-0796-4e1c-b15f-3f3e00382bd5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:04 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 Nov 05 22:31:04 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:05 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1" returned: 0 in 0.371s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:05 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1 Nov 05 22:31:05 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:05 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-1cdd478b-493e-4934-9104-1f46c3a7bab1" returned: 0 in 0.289s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-1cdd478b-493e-4934-9104-1f46c3a7bab1" released by "delete_volume" :: held 0.726s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (16566f47-4cf6-437a-9e2e-3aca12845804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927002b1-1c73-4ee7-85dc-5330643172c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927002b1-1c73-4ee7-85dc-5330643172c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314187294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa563b17-8115-403c-beeb-f3d33359bb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:05Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c4b671-0639-42fe-8f3f-f023ad6216c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c4b671-0639-42fe-8f3f-f023ad6216c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c40fc1-5b84-466c-916b-8b448579480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c40fc1-5b84-466c-916b-8b448579480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa563b17-8115-403c-beeb-f3d33359bb1c', 'volume_name': 'volume-aa563b17-8115-403c-beeb-f3d33359bb1c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e241299f-b02d-411c-ae9f-5608e92b3b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e241299f-b02d-411c-ae9f-5608e92b3b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e13289-6bc7-4d23-b579-795fdcd5f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume aa563b17-8115-403c-beeb-f3d33359bb1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa563b17-8115-403c-beeb-f3d33359bb1c', 'volume_size': 1} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-314187294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa563b17-8115-403c-beeb-f3d33359bb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:05Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Creating volume aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:05 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:05 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c 1073741824 Nov 05 22:31:05 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Created reservations ['d5f4727c-6455-44b2-913b-72765953a551', '8e2a0696-1bf4-4540-b7ea-90e85389e933', '09b003c1-90d6-4fd0-b9b9-6d85bfc4b0ad', '46608ed6-ca18-4a63-ab30-27bc7707bbad'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:05 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:05 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:05 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.253s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:05 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:05 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Deleted volume successfully. Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dfd612f6-00ff-4145-98d2-5bf9664888a2 tempest-TestStampPattern-1470570065 None] Lock "cinder-1cdd478b-493e-4934-9104-1f46c3a7bab1-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:06 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c 1073741824" returned: 0 in 0.521s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-dcba029e-9102-4c4b-891c-c658f2dfcdb1-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:06 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c Nov 05 22:31:06 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Lock "cinder-dcba029e-9102-4c4b-891c-c658f2dfcdb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-quobyte-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-quobyte-dcba029e-9102-4c4b-891c-c658f2dfcdb1" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-dcba029e-9102-4c4b-891c-c658f2dfcdb1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Deleting offline snapshot dcba029e-9102-4c4b-891c-c658f2dfcdb1 of volume deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] snapshot_file for this snap is: volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb6c586-442f-4614-93be-2b64eec9ce78]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:06 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 Nov 05 22:31:06 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:06 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c" returned: 0 in 0.269s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e13289-6bc7-4d23-b579-795fdcd5f461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa563b17-8115-403c-beeb-f3d33359bb1c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028148b7-6eeb-40a9-9228-fcf41315d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:06 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume volume-aa563b17-8115-403c-beeb-f3d33359bb1c (aa563b17-8115-403c-beeb-f3d33359bb1c): created successfully Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028148b7-6eeb-40a9-9228-fcf41315d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (16566f47-4cf6-437a-9e2e-3aca12845804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8f274a86-462a-4fca-8cb4-fe33281ae6f2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created volume successfully. Nov 05 22:31:06 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1" returned: 0 in 0.369s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbdf8f3-36c0-413e-8453-7e923c7dc766]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:06 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e Nov 05 22:31:06 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:07 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" returned: 0 in 0.523s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:07 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 Nov 05 22:31:07 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:07 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1" returned: 0 in 0.344s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:07 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1 Nov 05 22:31:07 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Creating offline snapshot 78476e18-71a8-41c4-8113-f02e4154cf8a of volume aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:31:07 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1e52ee-ce98-4392-abed-40151bc504ae]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e.dcba029e-9102-4c4b-891c-c658f2dfcdb1" returned: 0 in 0.273s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-dcba029e-9102-4c4b-891c-c658f2dfcdb1" released by "_delete_snapshot" :: held 1.612s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" released by "delete_snapshot" :: held 1.634s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:07 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Created reservations ['ab57a76f-c5d0-4a14-ba2e-11fd3ecbf729', 'dadf46ce-908b-4228-9e1c-2117aec116ae', '9612d45f-4584-4c68-9ad6-2fcd37bf0d51', '3ffb66f1-9cee-4636-8aa0-bbf6f30f6874'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:07 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Delete snapshot completed successfully. Nov 05 22:31:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e173f65d-4b67-47f2-948b-2958dcb3c4f3 tempest-TestStampPattern-1470570065 None] Lock "cinder-dcba029e-9102-4c4b-891c-c658f2dfcdb1-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:08 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c" returned: 0 in 0.365s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:08 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a 1G Nov 05 22:31:08 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:08 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a 1G" returned: 0 in 0.424s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa563b17-8115-403c-beeb-f3d33359bb1c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:08 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa563b17-8115-403c-beeb-f3d33359bb1c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a Nov 05 22:31:08 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:08 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa563b17-8115-403c-beeb-f3d33359bb1c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a" returned: 0 in 0.296s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:08 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a is being set with open permissions: ugo+rw Nov 05 22:31:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:08 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a Nov 05 22:31:08 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:09 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a" returned: 0 in 0.310s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:09 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.info Nov 05 22:31:09 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:09 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.info" returned: 0 in 0.295s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:09 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.info is being set with open permissions: ugo+rw Nov 05 22:31:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:09 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.info Nov 05 22:31:09 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:09 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.info" returned: 0 in 0.394s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.214s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6dda0286-a01e-419f-868b-ab95d9b44644 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Create snapshot completed successfully Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (cac33a89-c071-4b73-b74d-19cbb493d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b01faaa-7158-4648-b8e9-d2e00112c1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b01faaa-7158-4648-b8e9-d2e00112c1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659338762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faff4f3-b5b4-43b8-a160-b85d44a970e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:11Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b018410-29f4-4378-b5aa-e3c70010fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b018410-29f4-4378-b5aa-e3c70010fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a86e13-1a96-4f6a-939c-3514a4b8277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a86e13-1a96-4f6a-939c-3514a4b8277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9faff4f3-b5b4-43b8-a160-b85d44a970e2', 'volume_name': 'volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5ac8c-6544-4a0e-aab9-5d6fb821de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b5ac8c-6544-4a0e-aab9-5d6fb821de22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafae57b-a6f5-49dc-9292-e4ac91932040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume 9faff4f3-b5b4-43b8-a160-b85d44a970e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2', 'volume_size': 1} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659338762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9faff4f3-b5b4-43b8-a160-b85d44a970e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:11Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Creating volume 9faff4f3-b5b4-43b8-a160-b85d44a970e2 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:11 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:11 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 1073741824 Nov 05 22:31:11 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (75bf5086-baeb-4026-8a8b-e03afd128cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb83fd9-e8ad-4803-a8d7-ccf5228c5ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb83fd9-e8ad-4803-a8d7-ccf5228c5ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-991927707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a485e219-ee8b-4e20-afcb-fe3c2b781d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:12Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec36515-7a65-4d95-a010-358be42f2321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec36515-7a65-4d95-a010-358be42f2321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad29843b-085c-45e2-b33f-a18e7ede9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad29843b-085c-45e2-b33f-a18e7ede9654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a485e219-ee8b-4e20-afcb-fe3c2b781d90', 'volume_name': 'volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516914d5-0a05-4611-92c3-27740d7800d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516914d5-0a05-4611-92c3-27740d7800d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035ad8e2-c90d-4fe9-8b0a-69d6039397c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume a485e219-ee8b-4e20-afcb-fe3c2b781d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90', 'volume_size': 1} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Lock "cinder-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Acquiring lock "cinder-quobyte-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659fde0-5db1-4605-bbed-39cd269a6165]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:12 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 1073741824" returned: 0 in 0.599s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:12 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 Nov 05 22:31:12 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:12 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e Nov 05 22:31:12 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (a9ffd1b9-6cb5-4be6-b469-0cd31506e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750bd95a-c75a-492e-aa42-147e73c3ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750bd95a-c75a-492e-aa42-147e73c3ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506823013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c542a2-6cd0-41ef-905f-ab7b35eb00ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:12Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3c1f9f-89f5-49e9-ba3e-9f7d216de5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3c1f9f-89f5-49e9-ba3e-9f7d216de5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d29a97-805e-4660-9d63-249d9d42e5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d29a97-805e-4660-9d63-249d9d42e5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c542a2-6cd0-41ef-905f-ab7b35eb00ab', 'volume_name': 'volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9081557-7fdc-4f2b-aa19-09130c491f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9081557-7fdc-4f2b-aa19-09130c491f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd632868-020d-4c1c-8d34-23670db962a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume 03c542a2-6cd0-41ef-905f-ab7b35eb00ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab', 'volume_size': 1} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:12 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2" returned: 0 in 0.352s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-991927707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a485e219-ee8b-4e20-afcb-fe3c2b781d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:12Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Creating volume a485e219-ee8b-4e20-afcb-fe3c2b781d90 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:12 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:12 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" returned: 0 in 0.487s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:12 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 1073741824 Nov 05 22:31:12 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafae57b-a6f5-49dc-9292-e4ac91932040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86046f4e-4127-4cea-ae2a-081c250efe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e Nov 05 22:31:12 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 (9faff4f3-b5b4-43b8-a160-b85d44a970e2): created successfully Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86046f4e-4127-4cea-ae2a-081c250efe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (cac33a89-c071-4b73-b74d-19cbb493d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (25c34fe8-8c32-412b-a440-a0b850261369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dba552f-6253-4b5d-b2c6-317ba0957def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-33ea19cb-270d-48cd-9527-9b6c9fb75bfb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created volume successfully. Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dba552f-6253-4b5d-b2c6-317ba0957def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772725764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd829bd-c200-484e-9fab-150895e4753d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:13Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e247cdaa-3e1c-4fe5-a310-94448050b729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e247cdaa-3e1c-4fe5-a310-94448050b729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5187b8cd-f585-4a20-a4d1-a845fb40ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5187b8cd-f585-4a20-a4d1-a845fb40ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd829bd-c200-484e-9fab-150895e4753d', 'volume_name': 'volume-fdd829bd-c200-484e-9fab-150895e4753d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756c979c-358b-467e-bfdd-b9f2e6d55890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756c979c-358b-467e-bfdd-b9f2e6d55890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7b1397-1714-4486-9a39-c8502d50fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume fdd829bd-c200-484e-9fab-150895e4753d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd829bd-c200-484e-9fab-150895e4753d', 'volume_size': 1} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:12 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" returned: 0 in 0.309s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Lock "cinder-quobyte-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e" released by "delete_volume" :: held 0.888s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:12 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Created reservations ['972634d4-fc8c-4011-b700-0bc20823be28', '4fdb8479-2a7e-486c-b683-8b01176fb109', '3a298964-deb6-4d31-8ef4-669a47800ae1', '12cf34aa-ac39-4aac-944c-e80a2484e15f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (93066545-3db0-43e9-9b00-7a01aee17cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a313f6b9-a1de-4508-8d58-38928f0bb9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:13 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 1073741824" returned: 0 in 0.567s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a313f6b9-a1de-4508-8d58-38928f0bb9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835452226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295c9147-105b-422d-b944-c27fd1615abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:13Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba8e95f-6d5c-45bd-9e73-6c39234941f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:13 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:13 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba8e95f-6d5c-45bd-9e73-6c39234941f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c62df6-efc6-44a0-8a61-938626a8c8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c62df6-efc6-44a0-8a61-938626a8c8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295c9147-105b-422d-b944-c27fd1615abf', 'volume_name': 'volume-295c9147-105b-422d-b944-c27fd1615abf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cdef7e-4784-4dd3-8587-fa998df6eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cdef7e-4784-4dd3-8587-fa998df6eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d67676-69d8-4a49-a6b5-6e18a20d6c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume 295c9147-105b-422d-b944-c27fd1615abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295c9147-105b-422d-b944-c27fd1615abf', 'volume_size': 1} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:13 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 Nov 05 22:31:13 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:13 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.286s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Deleted volume successfully. Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dc095db2-ccd0-4e73-86cf-6457178dd5af tempest-TestStampPattern-1470570065 None] Lock "cinder-deab59fc-f6f2-4b74-8a1f-3cec391b8e1e-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:13 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90" returned: 0 in 0.282s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506823013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c542a2-6cd0-41ef-905f-ab7b35eb00ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:12Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Creating volume 03c542a2-6cd0-41ef-905f-ab7b35eb00ab {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:13 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:13 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab 1073741824 Nov 05 22:31:13 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035ad8e2-c90d-4fe9-8b0a-69d6039397c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4d0573-7c74-406d-b5b0-dbeb6e8158f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 (a485e219-ee8b-4e20-afcb-fe3c2b781d90): created successfully Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4d0573-7c74-406d-b5b0-dbeb6e8158f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (75bf5086-baeb-4026-8a8b-e03afd128cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-efabe4a0-e1d1-481d-92bc-3b6c476551b9 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created volume successfully. Nov 05 22:31:13 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab 1073741824" returned: 0 in 0.421s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:13 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab Nov 05 22:31:14 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:14 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab" returned: 0 in 0.292s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-772725764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd829bd-c200-484e-9fab-150895e4753d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:13Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Creating volume fdd829bd-c200-484e-9fab-150895e4753d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:14 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd632868-020d-4c1c-8d34-23670db962a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:14 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d 1073741824 Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e473baa7-4f6f-42ae-992d-f63ec823da78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:14 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:14 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab (03c542a2-6cd0-41ef-905f-ab7b35eb00ab): created successfully Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e473baa7-4f6f-42ae-992d-f63ec823da78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (a9ffd1b9-6cb5-4be6-b469-0cd31506e96f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:14 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8634d07c-c283-46d4-be86-e972f91c253d tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created volume successfully. Nov 05 22:31:14 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d 1073741824" returned: 0 in 0.415s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:14 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d Nov 05 22:31:14 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:14 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d" returned: 0 in 0.244s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835452226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295c9147-105b-422d-b944-c27fd1615abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f11de4807742ddb6dd5dd398ef42f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:13Z,use_quota=True,user_id='73db3d181a1d42dc9acbd58186839ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Creating volume 295c9147-105b-422d-b944-c27fd1615abf {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:14 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7b1397-1714-4486-9a39-c8502d50fd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd829bd-c200-484e-9fab-150895e4753d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:15 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf 1073741824 Nov 05 22:31:15 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038fd70a-01bd-44b7-8bf7-7bf5baaad945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:15 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume volume-fdd829bd-c200-484e-9fab-150895e4753d (fdd829bd-c200-484e-9fab-150895e4753d): created successfully Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (038fd70a-01bd-44b7-8bf7-7bf5baaad945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (25c34fe8-8c32-412b-a440-a0b850261369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4fd9adc9-d01d-472e-a955-30948acb5cec tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created volume successfully. Nov 05 22:31:15 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf 1073741824" returned: 0 in 0.500s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:15 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf Nov 05 22:31:15 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:15 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf" returned: 0 in 0.267s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d67676-69d8-4a49-a6b5-6e18a20d6c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295c9147-105b-422d-b944-c27fd1615abf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0540b67f-9799-4843-abe4-c2346d8c3da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:15 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Volume volume-295c9147-105b-422d-b944-c27fd1615abf (295c9147-105b-422d-b944-c27fd1615abf): created successfully Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0540b67f-9799-4843-abe4-c2346d8c3da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Flow 'volume_create_manager' (93066545-3db0-43e9-9b00-7a01aee17cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ccd8da88-6123-4b2e-a919-fa9aebf0f0bf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created volume successfully. Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-295c9147-105b-422d-b944-c27fd1615abf-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-295c9147-105b-422d-b944-c27fd1615abf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-295c9147-105b-422d-b944-c27fd1615abf" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-295c9147-105b-422d-b944-c27fd1615abf" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc549c39-fa41-4cbf-9299-39d99a080c81]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:16 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf Nov 05 22:31:16 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:16 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:16 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf Nov 05 22:31:16 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:17 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-295c9147-105b-422d-b944-c27fd1615abf" returned: 0 in 0.247s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-295c9147-105b-422d-b944-c27fd1615abf" released by "delete_volume" :: held 0.653s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created reservations ['f94c0a0e-e541-4d3f-963a-e28003a006ae', '20ba9187-f5ff-4449-bae1-12b75e3bdf4e', '266b3343-9300-4cad-b381-fc2f752ee77a', '55192e1d-b150-465c-bb83-7de864c75e23'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:17 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:17 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:17 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.247s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:17 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Deleted volume successfully. Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ffb4358a-e497-4fa4-acc3-79c7bea57e11 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-295c9147-105b-422d-b944-c27fd1615abf-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-fdd829bd-c200-484e-9fab-150895e4753d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-fdd829bd-c200-484e-9fab-150895e4753d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-fdd829bd-c200-484e-9fab-150895e4753d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-fdd829bd-c200-484e-9fab-150895e4753d" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd5ae8b-75aa-4f7e-8f92-582beadf6ad4]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:17 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d Nov 05 22:31:17 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:18 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d" returned: 0 in 0.359s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:18 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d Nov 05 22:31:18 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:18 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fdd829bd-c200-484e-9fab-150895e4753d" returned: 0 in 0.321s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-fdd829bd-c200-484e-9fab-150895e4753d" released by "delete_volume" :: held 0.720s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created reservations ['44a04a6d-0b76-4d54-b408-cd1dec984563', '4eb38b91-4267-4562-b6ee-873d80190850', '7134c3ee-a1f8-4fcf-805b-d09bfdc4dfe2', '202b8361-596e-4e6f-bed4-37004b5b9e85'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:18 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:18 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:18 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-03c542a2-6cd0-41ef-905f-ab7b35eb00ab-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.254s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Deleted volume successfully. Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-03c542a2-6cd0-41ef-905f-ab7b35eb00ab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-395a3dbe-c582-4ce5-a571-235666d1dbcf tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-fdd829bd-c200-484e-9fab-150895e4753d-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-03c542a2-6cd0-41ef-905f-ab7b35eb00ab" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-03c542a2-6cd0-41ef-905f-ab7b35eb00ab" acquired by "delete_volume" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b27a1f-989e-4170-a8ba-9be38cba8f46]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:19 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab Nov 05 22:31:19 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:19 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab" returned: 0 in 0.419s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:19 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab Nov 05 22:31:19 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:19 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-03c542a2-6cd0-41ef-905f-ab7b35eb00ab" returned: 0 in 0.244s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-03c542a2-6cd0-41ef-905f-ab7b35eb00ab" released by "delete_volume" :: held 0.710s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created reservations ['a5c2a12d-8d44-4f2b-b021-1665abf489bf', '29eb0dfb-8048-4a8a-bf35-911a2a79c400', 'cad806ac-7cb5-4dbd-8346-d3a4908965fe', 'af8fc55b-0475-4bd4-9797-a255a6c88082'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:19 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:19 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:19 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-a485e219-ee8b-4e20-afcb-fe3c2b781d90-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.298s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:19 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:19 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Deleted volume successfully. Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-a485e219-ee8b-4e20-afcb-fe3c2b781d90-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a86d00b-d58a-4edf-b3e8-eb75af04cafd tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-03c542a2-6cd0-41ef-905f-ab7b35eb00ab-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-a485e219-ee8b-4e20-afcb-fe3c2b781d90" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-a485e219-ee8b-4e20-afcb-fe3c2b781d90" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d484c812-1f58-491b-ac97-145ab96b058c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:20 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 Nov 05 22:31:20 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:20 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90" returned: 0 in 0.370s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:20 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90 Nov 05 22:31:20 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:20 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-a485e219-ee8b-4e20-afcb-fe3c2b781d90" returned: 0 in 0.304s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-a485e219-ee8b-4e20-afcb-fe3c2b781d90" released by "delete_volume" :: held 0.727s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created reservations ['04a8f7bb-35fd-46b2-9fb0-df341dd8296e', '58cacb8b-aac9-47c0-8510-fd26980e0852', '28de072d-2f4e-46b5-a85f-2a0e01723cdf', 'a0f842e4-0fb6-4cb1-8054-89d353aa23dd'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:20 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:20 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:21 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.248s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-9faff4f3-b5b4-43b8-a160-b85d44a970e2-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Deleted volume successfully. Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-9faff4f3-b5b4-43b8-a160-b85d44a970e2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c61a5d07-f29f-4d05-845c-4d8d162de0f1 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-a485e219-ee8b-4e20-afcb-fe3c2b781d90-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-9faff4f3-b5b4-43b8-a160-b85d44a970e2" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-9faff4f3-b5b4-43b8-a160-b85d44a970e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac3cd5c-ac4c-445f-b016-308031e131f3]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:21 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 Nov 05 22:31:21 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:21 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2" returned: 0 in 0.386s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:21 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2 Nov 05 22:31:21 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:21 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9faff4f3-b5b4-43b8-a160-b85d44a970e2" returned: 0 in 0.253s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-9faff4f3-b5b4-43b8-a160-b85d44a970e2" released by "delete_volume" :: held 0.688s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created reservations ['1a70f36f-2b81-4993-9446-6a39758869fd', 'b1895367-9187-4c88-84ea-9d8dfbe6a79a', 'e3802376-0370-4b22-a75e-b59aaa775435', 'f48afaba-07d9-44ac-9d37-7e6895709758'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:22 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:22 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:22 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.255s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:22 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Deleted volume successfully. Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-13da8b73-ca03-4c39-afe7-ded827ce431a tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-9faff4f3-b5b4-43b8-a160-b85d44a970e2-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-78476e18-71a8-41c4-8113-f02e4154cf8a-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-78476e18-71a8-41c4-8113-f02e4154cf8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-aa563b17-8115-403c-beeb-f3d33359bb1c" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-aa563b17-8115-403c-beeb-f3d33359bb1c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-78476e18-71a8-41c4-8113-f02e4154cf8a" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-78476e18-71a8-41c4-8113-f02e4154cf8a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Deleting offline snapshot 78476e18-71a8-41c4-8113-f02e4154cf8a of volume aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] snapshot_file for this snap is: volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2c34a2-749b-4707-889e-9365d98b6922]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:22 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a Nov 05 22:31:22 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:22 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a" returned: 0 in 0.418s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa563b17-8115-403c-beeb-f3d33359bb1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46d584a-279a-4a78-b72e-f1a118117c60]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:23 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c Nov 05 22:31:23 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:23 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c" returned: 0 in 0.386s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:23 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a Nov 05 22:31:23 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:23 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a" returned: 0 in 0.367s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:23 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a Nov 05 22:31:23 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:23 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c.78476e18-71a8-41c4-8113-f02e4154cf8a" returned: 0 in 0.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-78476e18-71a8-41c4-8113-f02e4154cf8a" released by "_delete_snapshot" :: held 1.559s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-aa563b17-8115-403c-beeb-f3d33359bb1c" released by "delete_snapshot" :: held 1.584s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created reservations ['922f9e4f-7ae5-4f9a-a163-4834935ff8bb', '058caa7c-1fc8-405c-a560-81e077e9f160', '302ba2e0-1993-4e19-b4ec-34ba5111cb65', '97a25757-e4c6-4178-ab91-34b8de9980c7'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:24 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Delete snapshot completed successfully. Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-1acf2648-702c-4796-bb2d-3721c551aabb tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-78476e18-71a8-41c4-8113-f02e4154cf8a-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-aa563b17-8115-403c-beeb-f3d33359bb1c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-aa563b17-8115-403c-beeb-f3d33359bb1c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "cinder-quobyte-aa563b17-8115-403c-beeb-f3d33359bb1c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-aa563b17-8115-403c-beeb-f3d33359bb1c" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d185b641-bdc7-4643-a51d-37d53a3660fa]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:24 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c Nov 05 22:31:24 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:25 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c" returned: 0 in 0.387s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:25 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c Nov 05 22:31:25 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:25 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-aa563b17-8115-403c-beeb-f3d33359bb1c" returned: 0 in 0.293s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-quobyte-aa563b17-8115-403c-beeb-f3d33359bb1c" released by "delete_volume" :: held 0.746s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Created reservations ['8bd07fa6-00f4-4cf9-884b-f52eb30a3d2a', '94597f0f-8bdf-4c71-9214-213e0ff38481', '6e06129a-7db8-4d93-ad3d-5fb4c508ac80', '28b95684-4d2e-484b-ada4-d729c397e19b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:25 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:25 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:25 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.278s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Deleted volume successfully. Nov 05 22:31:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-72025198-d6b1-4da8-be20-3711ed12bca2 tempest-CreateVolumesFromSnapshotTest-1193017599 None] Lock "cinder-aa563b17-8115-403c-beeb-f3d33359bb1c-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (bc0afdbe-6d3d-4709-8607-5ffca05059ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a01ed75-cd5f-4dc9-9854-b39eaa730dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a01ed75-cd5f-4dc9-9854-b39eaa730dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940353972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8392965-81c8-4680-80c5-f8879669b1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:29Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7c9eaf-9252-45ce-98ea-a23d17f8a33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7c9eaf-9252-45ce-98ea-a23d17f8a33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf3794b-e6ef-45a5-be39-518c9aa814ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf3794b-e6ef-45a5-be39-518c9aa814ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8392965-81c8-4680-80c5-f8879669b1bb', 'volume_name': 'volume-b8392965-81c8-4680-80c5-f8879669b1bb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b382da-eca4-44b7-8ad5-b40122a0559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b382da-eca4-44b7-8ad5-b40122a0559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad0294d-6146-4f2b-8711-8a61e761581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:28 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume b8392965-81c8-4680-80c5-f8879669b1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8392965-81c8-4680-80c5-f8879669b1bb', 'volume_size': 1} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-940353972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8392965-81c8-4680-80c5-f8879669b1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:29Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Creating volume b8392965-81c8-4680-80c5-f8879669b1bb {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:28 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:28 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb 1073741824 Nov 05 22:31:28 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:29 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb 1073741824" returned: 0 in 0.476s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:29 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb Nov 05 22:31:29 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:29 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb" returned: 0 in 0.253s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad0294d-6146-4f2b-8711-8a61e761581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8392965-81c8-4680-80c5-f8879669b1bb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da9771-0ef5-41d1-a9f2-c64c27ab140d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:29 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume volume-b8392965-81c8-4680-80c5-f8879669b1bb (b8392965-81c8-4680-80c5-f8879669b1bb): created successfully Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05da9771-0ef5-41d1-a9f2-c64c27ab140d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (bc0afdbe-6d3d-4709-8607-5ffca05059ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a569d0e8-61c6-4dab-a538-f4a020e83e47 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created volume successfully. Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Flow 'volume_create_manager' (4dd00ee7-e395-4e36-978e-46a3f22f29f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a21af32-2319-4f9c-859e-ac7a7becd877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a21af32-2319-4f9c-859e-ac7a7becd877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e9ef30-bed2-4b11-a35b-768177b96d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc463499f4649609dc6aff58d3592dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:30Z,use_quota=True,user_id='a6e2133139124f46b9ea88b32d990bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bbefaf1-cc2b-4dfe-beb6-cdd5591f81e9),volume_type_id=2bbefaf1-cc2b-4dfe-beb6-cdd5591f81e9)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b3c6d5-a8de-48a8-a39f-1b6cfb61f17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b3c6d5-a8de-48a8-a39f-1b6cfb61f17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7d1c99-8f85-4440-bab1-ee5da1fb26cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7d1c99-8f85-4440-bab1-ee5da1fb26cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74e9ef30-bed2-4b11-a35b-768177b96d53', 'volume_name': 'volume-74e9ef30-bed2-4b11-a35b-768177b96d53', 'volume_size': 1, 'image_id': '6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7343db21f87e05ee5d010bd47fa8d1e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ecc463499f4649609dc6aff58d3592dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46a486a40faa70612e5db0ee1182d067bd5b1dd3b80210ac97434b00448ca8339e6ab8dea444c4951f33ba33ffaa58627948e7a13d15842c84710e2ec49bf58d', 'id': '6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'created_at': datetime.datetime(2026, 11, 5, 21, 31, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 31, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f10d9e-21fd-402e-a7b5-0787d536fdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f10d9e-21fd-402e-a7b5-0787d536fdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe83b724-a213-4dcc-92c5-dc0f1714c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:30 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Volume 74e9ef30-bed2-4b11-a35b-768177b96d53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74e9ef30-bed2-4b11-a35b-768177b96d53', 'volume_size': 1, 'image_id': '6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7343db21f87e05ee5d010bd47fa8d1e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ecc463499f4649609dc6aff58d3592dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46a486a40faa70612e5db0ee1182d067bd5b1dd3b80210ac97434b00448ca8339e6ab8dea444c4951f33ba33ffaa58627948e7a13d15842c84710e2ec49bf58d', 'id': '6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'created_at': datetime.datetime(2026, 11, 5, 21, 31, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 31, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 22:31:30 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Trying to clone 74e9ef30-bed2-4b11-a35b-768177b96d53 from image 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:31:31 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a10f6-fa13-4737-a6ac-8650456c997f]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (13dd82e3-6c12-4bc8-ad38-b80344667ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a26df3b-049a-4b84-a7a2-195b5a819717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD Nov 05 22:31:31 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a26df3b-049a-4b84-a7a2-195b5a819717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-571870859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f904a9-f8b8-4ca7-aa78-f38106178741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:31Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17e8d39-168e-4d32-9207-fcf7b5349dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17e8d39-168e-4d32-9207-fcf7b5349dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bd30b0-bf72-459e-9353-074c9f451579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bd30b0-bf72-459e-9353-074c9f451579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f904a9-f8b8-4ca7-aa78-f38106178741', 'volume_name': 'volume-c3f904a9-f8b8-4ca7-aa78-f38106178741', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cd5bb4-575c-458c-9c2f-631926c3006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cd5bb4-575c-458c-9c2f-631926c3006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939b8558-802e-49f6-8442-e93b7da1c57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume c3f904a9-f8b8-4ca7-aa78-f38106178741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f904a9-f8b8-4ca7-aa78-f38106178741', 'volume_size': 1} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-571870859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f904a9-f8b8-4ca7-aa78-f38106178741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:31Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Creating volume c3f904a9-f8b8-4ca7-aa78-f38106178741 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:31 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:31 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 1073741824 Nov 05 22:31:31 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:31 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (acbd2251-fa1c-4373-8afe-856ef4d95f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f3e024-e583-4760-9263-5d3de4fd12d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f3e024-e583-4760-9263-5d3de4fd12d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797184368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071f6825-9c74-428f-ab7c-524996951674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:32Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7820f0cb-3ea4-4db2-80e7-e734dfab23b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7820f0cb-3ea4-4db2-80e7-e734dfab23b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f01842d-0f55-450f-9189-96825cbef66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f01842d-0f55-450f-9189-96825cbef66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071f6825-9c74-428f-ab7c-524996951674', 'volume_name': 'volume-071f6825-9c74-428f-ab7c-524996951674', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad29e2e1-bf59-45e3-b210-716d58fd64e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad29e2e1-bf59-45e3-b210-716d58fd64e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3590e552-893b-486e-ae09-6ead751a9a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume 071f6825-9c74-428f-ab7c-524996951674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071f6825-9c74-428f-ab7c-524996951674', 'volume_size': 1} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:31 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD Nov 05 22:31:31 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:31 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 1073741824" returned: 0 in 0.527s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:31 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 Nov 05 22:31:31 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:31 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (d78b79b0-e652-4a9b-9c22-9d871959980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99b10c0-9732-4a37-ac26-b868f86ab338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD" returned: 1 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Temporary image 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 is fetched for user a6e2133139124f46b9ea88b32d990bbe. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99b10c0-9732-4a37-ac26-b868f86ab338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596591992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf3a88d-36e7-4797-a0cf-0fb4b5ce1370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:32Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a538a-de83-4714-bcd0-c5c9198c3eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a538a-de83-4714-bcd0-c5c9198c3eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3a3f03-cb70-4eae-9ae1-658177cf4bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3a3f03-cb70-4eae-9ae1-658177cf4bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf3a88d-36e7-4797-a0cf-0fb4b5ce1370', 'volume_name': 'volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff3630b-20ab-49f6-a8c2-f50204bcf8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff3630b-20ab-49f6-a8c2-f50204bcf8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366337a4-0458-44ff-b1b8-544f1269d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume edf3a88d-36e7-4797-a0cf-0fb4b5ce1370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370', 'volume_size': 1} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[090050cd-2d44-42f3-87d0-8175744a71de]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:32 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741" returned: 0 in 0.298s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.495s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1797184368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071f6825-9c74-428f-ab7c-524996951674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:32Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Creating volume 071f6825-9c74-428f-ab7c-524996951674 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:32 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939b8558-802e-49f6-8442-e93b7da1c57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f904a9-f8b8-4ca7-aa78-f38106178741', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17110a2a-6b01-4ce2-9295-2ce046e8dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 1073741824 Nov 05 22:31:32 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 (c3f904a9-f8b8-4ca7-aa78-f38106178741): created successfully Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17110a2a-6b01-4ce2-9295-2ce046e8dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (13dd82e3-6c12-4bc8-ad38-b80344667ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:32 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ae35560b-234a-4cac-8574-8f48cea27d57 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created volume successfully. Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (09d60f5a-fe7d-48a4-9743-e1888c182799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88aeae0-582a-4a6d-9a07-4c3b95f63ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88aeae0-582a-4a6d-9a07-4c3b95f63ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2112749373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c94acd-db6d-47a4-ab44-194efaf62a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:32Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f215fa5-3975-4d00-ba42-2cd8e824b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f215fa5-3975-4d00-ba42-2cd8e824b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52735c5e-4a14-44be-8280-8cfe0bb1c0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52735c5e-4a14-44be-8280-8cfe0bb1c0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c94acd-db6d-47a4-ab44-194efaf62a7d', 'volume_name': 'volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081e8805-6825-43f6-9044-80934ff390ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081e8805-6825-43f6-9044-80934ff390ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8f7ad9-328e-40fb-8176-6c6f8e88076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume c6c94acd-db6d-47a4-ab44-194efaf62a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d', 'volume_size': 1} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:32 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:32 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD Nov 05 22:31:32 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:32 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 1073741824" returned: 0 in 0.630s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (6683a735-f0d6-4533-940b-df5fdf9a9ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cb55d4-47cb-40b5-b5ef-d175dd441b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cb55d4-47cb-40b5-b5ef-d175dd441b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759103541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed08370-aeca-4082-87cc-42a8faf24ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:33Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77bbcff-8588-441c-9568-67aa8652ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77bbcff-8588-441c-9568-67aa8652ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c9d060-a399-4094-ab14-e7bc6f6a4b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c9d060-a399-4094-ab14-e7bc6f6a4b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed08370-aeca-4082-87cc-42a8faf24ab0', 'volume_name': 'volume-2ed08370-aeca-4082-87cc-42a8faf24ab0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d77f600-808c-449a-9f03-5924da0c3ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d77f600-808c-449a-9f03-5924da0c3ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0084db6d-ebb4-4f0c-8b09-d4c9c6f0189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume 2ed08370-aeca-4082-87cc-42a8faf24ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed08370-aeca-4082-87cc-42a8faf24ab0', 'volume_size': 1} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:32 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:31:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:32 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 Nov 05 22:31:32 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:33 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674" returned: 0 in 0.268s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596591992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf3a88d-36e7-4797-a0cf-0fb4b5ce1370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:32Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Creating volume edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:33 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:33 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 1073741824 Nov 05 22:31:33 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3590e552-893b-486e-ae09-6ead751a9a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071f6825-9c74-428f-ab7c-524996951674', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6914607d-9eb8-41fe-a202-5ae9d6159fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:33 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume volume-071f6825-9c74-428f-ab7c-524996951674 (071f6825-9c74-428f-ab7c-524996951674): created successfully Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6914607d-9eb8-41fe-a202-5ae9d6159fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (acbd2251-fa1c-4373-8afe-856ef4d95f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f3a0b79d-dd9e-4a7b-87ec-7d57efb9aaef tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created volume successfully. Nov 05 22:31:33 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 1073741824" returned: 0 in 0.409s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:33 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 Nov 05 22:31:33 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:33 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370" returned: 0 in 0.246s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2112749373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c94acd-db6d-47a4-ab44-194efaf62a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:32Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Creating volume c6c94acd-db6d-47a4-ab44-194efaf62a7d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:33 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366337a4-0458-44ff-b1b8-544f1269d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:33 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d 1073741824 Nov 05 22:31:33 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c8d38c-baf6-41fb-96fd-36fbec095f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:33 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 (edf3a88d-36e7-4797-a0cf-0fb4b5ce1370): created successfully Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c8d38c-baf6-41fb-96fd-36fbec095f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (d78b79b0-e652-4a9b-9c22-9d871959980e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9e7a0de0-baf9-4231-b74f-bf42a738b20f tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created volume successfully. Nov 05 22:31:34 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d 1073741824" returned: 0 in 0.399s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:34 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d Nov 05 22:31:34 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:34 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d" returned: 0 in 0.239s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1759103541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed08370-aeca-4082-87cc-42a8faf24ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e623f1a2b9e44970aab8b738679d1e3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:33Z,use_quota=True,user_id='cec557be70b94a91bf2bc0f0d6db33e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Creating volume 2ed08370-aeca-4082-87cc-42a8faf24ab0 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:34 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8f7ad9-328e-40fb-8176-6c6f8e88076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:34 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 1073741824 Nov 05 22:31:34 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa91150-d4af-4aff-8bca-c62df521a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:34 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d (c6c94acd-db6d-47a4-ab44-194efaf62a7d): created successfully Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa91150-d4af-4aff-8bca-c62df521a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (09d60f5a-fe7d-48a4-9743-e1888c182799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:34 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e4a1a066-5c2b-4649-a9a5-5fc4a79dd278 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created volume successfully. Nov 05 22:31:35 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 1073741824" returned: 0 in 0.489s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:35 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 Nov 05 22:31:35 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:35 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e9ef30-bed2-4b11-a35b-768177b96d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc463499f4649609dc6aff58d3592dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:30Z,use_quota=True,user_id='a6e2133139124f46b9ea88b32d990bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bbefaf1-cc2b-4dfe-beb6-cdd5591f81e9),volume_type_id=2bbefaf1-cc2b-4dfe-beb6-cdd5591f81e9)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Creating volume 74e9ef30-bed2-4b11-a35b-768177b96d53 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:35 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0084db6d-ebb4-4f0c-8b09-d4c9c6f0189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed08370-aeca-4082-87cc-42a8faf24ab0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:35 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 1073741824 Nov 05 22:31:35 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed090821-12b5-4adc-a046-89a067c985d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Volume volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 (2ed08370-aeca-4082-87cc-42a8faf24ab0): created successfully Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed090821-12b5-4adc-a046-89a067c985d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Flow 'volume_create_manager' (6683a735-f0d6-4533-940b-df5fdf9a9ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c363de87-3433-413c-bdbe-1ce398e8a898 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created volume successfully. Nov 05 22:31:35 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 1073741824" returned: 0 in 0.408s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:35 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 Nov 05 22:31:35 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:36 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53" returned: 0 in 0.237s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Attempting download of 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 ((None, [{'url': 'file:///opt/stack/data/glance/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'metadata': {}}])) to volume 74e9ef30-bed2-4b11-a35b-768177b96d53. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd44fa3-67ee-4bbb-97ee-218e15afe8ae]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_nlk_m2oi {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-2ed08370-aeca-4082-87cc-42a8faf24ab0-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:36 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_nlk_m2oi Nov 05 22:31:36 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-2ed08370-aeca-4082-87cc-42a8faf24ab0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-quobyte-2ed08370-aeca-4082-87cc-42a8faf24ab0" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-2ed08370-aeca-4082-87cc-42a8faf24ab0" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f457b879-6c35-4c78-a619-cac06f01580e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:36 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 Nov 05 22:31:36 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:36 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_nlk_m2oi" returned: 0 in 0.351s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_nlk_m2oi {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:36 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_nlk_m2oi Nov 05 22:31:36 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:36 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0" returned: 0 in 0.367s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:36 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0 Nov 05 22:31:36 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:36 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_nlk_m2oi" returned: 1 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_nlk_m2oi' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7246ed1-74e5-4fc9-8189-2748c73784c6]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:36 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD Nov 05 22:31:36 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:36 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2ed08370-aeca-4082-87cc-42a8faf24ab0" returned: 0 in 0.282s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-2ed08370-aeca-4082-87cc-42a8faf24ab0" released by "delete_volume" :: held 0.704s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created reservations ['6928a338-41fa-4409-87b7-e8425470f7ca', 'dc9b21e2-4640-4c52-8e32-edce30f0c1c5', '1c2db8ea-496f-49b2-9695-2d3c349dfa85', '449bab22-8138-427c-8b4f-bbea3cbf66dc'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:37 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:37 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:37 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:37 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD Nov 05 22:31:37 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-c6c94acd-db6d-47a4-ab44-194efaf62a7d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:37 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-c6c94acd-db6d-47a4-ab44-194efaf62a7d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.291s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Deleted volume successfully. Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c428b9e7-fdb4-45d9-a1c0-05110b12a454 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-2ed08370-aeca-4082-87cc-42a8faf24ab0-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-quobyte-c6c94acd-db6d-47a4-ab44-194efaf62a7d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-c6c94acd-db6d-47a4-ab44-194efaf62a7d" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c77b6e-9d7a-4f49-8a81-f59f6ad8cffa]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:37 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 was raw, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:37 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 Nov 05 22:31:37 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:37 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d Nov 05 22:31:37 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:37 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d" returned: 0 in 0.375s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:37 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d Nov 05 22:31:37 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:38 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53" returned: 0 in 0.468s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6236973d-cac9-4c4b-9dfd-9cfeef4ccb25_t4q504_xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:31:38 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:38 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 1G Nov 05 22:31:38 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:38 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c6c94acd-db6d-47a4-ab44-194efaf62a7d" returned: 0 in 0.272s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-c6c94acd-db6d-47a4-ab44-194efaf62a7d" released by "delete_volume" :: held 0.696s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created reservations ['60dcd75e-4b34-4491-b20d-2fe501850240', '3aea7260-c813-4ac2-a325-305383e92461', '16f80f8c-a6c2-44c5-8f7e-3746286337fc', '6e295e90-4895-4d2d-9ef0-0c3b9f4bc0b2'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:38 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:38 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:38 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 1G" returned: 0 in 0.342s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Downloaded image 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 ((None, [{'url': 'file:///opt/stack/data/glance/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'metadata': {}}])) to volume 74e9ef30-bed2-4b11-a35b-768177b96d53 successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Temporary image 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 for user a6e2133139124f46b9ea88b32d990bbe is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Marking volume 74e9ef30-bed2-4b11-a35b-768177b96d53 as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Copying metadata from image 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 to 74e9ef30-bed2-4b11-a35b-768177b96d53. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Creating volume glance metadata for volume 74e9ef30-bed2-4b11-a35b-768177b96d53 backed by image 6236973d-cac9-4c4b-9dfd-9cfeef4ccb25 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7343db21f87e05ee5d010bd47fa8d1e9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe83b724-a213-4dcc-92c5-dc0f1714c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e9ef30-bed2-4b11-a35b-768177b96d53', 'volume_size': 1, 'image_id': '6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7343db21f87e05ee5d010bd47fa8d1e9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ecc463499f4649609dc6aff58d3592dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46a486a40faa70612e5db0ee1182d067bd5b1dd3b80210ac97434b00448ca8339e6ab8dea444c4951f33ba33ffaa58627948e7a13d15842c84710e2ec49bf58d', 'id': '6236973d-cac9-4c4b-9dfd-9cfeef4ccb25', 'created_at': datetime.datetime(2026, 11, 5, 21, 31, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 31, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6236973d-cac9-4c4b-9dfd-9cfeef4ccb25/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6e4580-78d8-4558-879b-336b92191340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:38 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Volume volume-74e9ef30-bed2-4b11-a35b-768177b96d53 (74e9ef30-bed2-4b11-a35b-768177b96d53): created successfully Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6e4580-78d8-4558-879b-336b92191340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Flow 'volume_create_manager' (4dd00ee7-e395-4e36-978e-46a3f22f29f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e0df48ad-28ae-4576-8b6b-4fbaa506a2f3 tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Created volume successfully. Nov 05 22:31:38 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.265s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Deleted volume successfully. Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9a47c7c-659b-448b-adf1-97d5a2f9b823 tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-c6c94acd-db6d-47a4-ab44-194efaf62a7d-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-quobyte-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345ba0a-3732-410f-9f78-4f3aab87fd2a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:38 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 Nov 05 22:31:38 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Acquiring lock "cinder-74e9ef30-bed2-4b11-a35b-768177b96d53-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:39 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "cinder-74e9ef30-bed2-4b11-a35b-768177b96d53-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:39 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370 Nov 05 22:31:39 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Acquiring lock "cinder-quobyte-74e9ef30-bed2-4b11-a35b-768177b96d53" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "cinder-quobyte-74e9ef30-bed2-4b11-a35b-768177b96d53" acquired by "delete_volume" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a253a0-58c4-409b-a4dc-2ceb595be278]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:39 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 Nov 05 22:31:39 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:39 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370" returned: 0 in 0.282s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370" released by "delete_volume" :: held 0.707s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created reservations ['0786ddd0-0e67-4061-8650-6bb175b3f227', 'f7e1c068-f795-489e-a798-9bb95da4fff8', 'a1a74078-29c1-4511-9a0b-55b54aa5fadc', '7a241549-deab-4724-92ed-da77cbbd2ec4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:39 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:39 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:39 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53" returned: 0 in 0.405s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:39 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53 Nov 05 22:31:39 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-071f6825-9c74-428f-ab7c-524996951674-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:39 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-071f6825-9c74-428f-ab7c-524996951674-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Deleted volume successfully. Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d73938de-6677-4dff-bcc6-35a6498d0e3a tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-edf3a88d-36e7-4797-a0cf-0fb4b5ce1370-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-quobyte-071f6825-9c74-428f-ab7c-524996951674" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-071f6825-9c74-428f-ab7c-524996951674" acquired by "delete_volume" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a16e7e-631a-4b91-be06-139ff6059185]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:39 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-74e9ef30-bed2-4b11-a35b-768177b96d53" returned: 0 in 0.302s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "cinder-quobyte-74e9ef30-bed2-4b11-a35b-768177b96d53" released by "delete_volume" :: held 0.754s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:39 devstack cinder-volume[87085]: WARNING cinder.quota [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:31:39 devstack cinder-volume[87085]: WARNING cinder.quota [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 22:31:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Created reservations ['90ce9e15-6fb8-4ecf-93ad-fca39252a0d0', '8e5b74a4-e113-4875-a716-98357c8ee83f', 'dfd33a73-1634-447f-99fa-043805e67beb', 'e55b3ffc-8263-4fb0-8556-745cdb1a2402'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:39 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 Nov 05 22:31:39 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:40 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:40 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:40 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674" returned: 0 in 0.396s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:40 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:40 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:40 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.290s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Deleted volume successfully. Nov 05 22:31:40 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674 Nov 05 22:31:40 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3a645233-8c54-4ca0-a1f9-daaf694a9f4f tempest-VolumeAndVolumeTypeFromImageTest-656192592 None] Lock "cinder-74e9ef30-bed2-4b11-a35b-768177b96d53-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:40 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.274s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:31:40 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-071f6825-9c74-428f-ab7c-524996951674" returned: 0 in 0.316s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-071f6825-9c74-428f-ab7c-524996951674" released by "delete_volume" :: held 0.773s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created reservations ['206f80bc-65e5-4c2c-833f-f879ca4f0662', '3f1f918f-4d47-4443-80d4-dfe3bb77b6e2', '9c86473d-d17e-48db-a406-d324598371b2', 'cc962473-8ac5-4803-8d60-b810ecca48fe'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:40 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:40 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-c3f904a9-f8b8-4ca7-aa78-f38106178741-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-c3f904a9-f8b8-4ca7-aa78-f38106178741-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-quobyte-c3f904a9-f8b8-4ca7-aa78-f38106178741" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:41 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.286s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-c3f904a9-f8b8-4ca7-aa78-f38106178741" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Deleted volume successfully. Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04bd3b6-1bb2-4ae3-a760-5e43b7a72598]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3b8fe974-4acd-4aa3-9400-a068c183b35c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-071f6825-9c74-428f-ab7c-524996951674-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:41 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 Nov 05 22:31:41 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:41 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741" returned: 0 in 0.444s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:41 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741 Nov 05 22:31:41 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:41 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c3f904a9-f8b8-4ca7-aa78-f38106178741" returned: 0 in 0.273s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-c3f904a9-f8b8-4ca7-aa78-f38106178741" released by "delete_volume" :: held 0.774s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created reservations ['c4a751c4-d6df-4c2d-b5b8-3d35fac6cf2c', 'a564c594-b74c-45a4-95b2-0d907cac1652', '351e784c-ffbb-40a5-a2d1-f8adfdac95d3', 'f3c2c867-16da-41b4-ade4-22cca2b4797b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:41 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:41 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-b8392965-81c8-4680-80c5-f8879669b1bb-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-b8392965-81c8-4680-80c5-f8879669b1bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "cinder-quobyte-b8392965-81c8-4680-80c5-f8879669b1bb" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:42 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.277s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Deleted volume successfully. Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-b8392965-81c8-4680-80c5-f8879669b1bb" acquired by "delete_volume" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ad817904-a72f-4866-a160-afce1fd884eb tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-c3f904a9-f8b8-4ca7-aa78-f38106178741-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[962b8df0-a38a-492e-9c7f-5d058181a52b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:42 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb Nov 05 22:31:42 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:42 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb" returned: 0 in 0.399s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:42 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb Nov 05 22:31:42 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:42 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b8392965-81c8-4680-80c5-f8879669b1bb" returned: 0 in 0.254s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-quobyte-b8392965-81c8-4680-80c5-f8879669b1bb" released by "delete_volume" :: held 0.704s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Created reservations ['6304cd82-509c-482d-bd4a-280269a2fcc5', '088bc34f-682d-4de0-9733-27f07da2850e', '56f07c55-4ed0-47b0-8b14-90793fcdf230', '49403405-ca81-4ebd-b627-5623b236a369'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:43 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:43 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:43 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.284s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:43 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Deleted volume successfully. Nov 05 22:31:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f82b620e-964a-4936-adc8-9433b5f41f8c tempest-CreateVolumesFromSourceVolumeTest-2070428418 None] Lock "cinder-b8392965-81c8-4680-80c5-f8879669b1bb-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (4a1caf03-4615-4523-8c39-04a645fee2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a566fe-8ba1-438e-8a8d-ba31c8063534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a566fe-8ba1-438e-8a8d-ba31c8063534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127955116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee04a78-4509-421a-a3d9-b3775aec7f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:46Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f8b802-8a8c-4dcd-9f3e-06e6b2018052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f8b802-8a8c-4dcd-9f3e-06e6b2018052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9420c3-adef-40d8-b407-e8b9994e3dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9420c3-adef-40d8-b407-e8b9994e3dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee04a78-4509-421a-a3d9-b3775aec7f8b', 'volume_name': 'volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2982416f-922a-40fc-95c4-dd45f604506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2982416f-922a-40fc-95c4-dd45f604506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f6312f-cb96-42b5-9cce-3c30fe2c21c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Volume 0ee04a78-4509-421a-a3d9-b3775aec7f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b', 'volume_size': 1} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127955116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee04a78-4509-421a-a3d9-b3775aec7f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:46Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Creating volume 0ee04a78-4509-421a-a3d9-b3775aec7f8b {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:46 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:46 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b 1073741824 Nov 05 22:31:46 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=140,cinder:INSERT=49,cinder:UPDATE=189,cinder:DELETE=16 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=185,cinder:SELECT=137,cinder:INSERT=48,cinder:DELETE=15 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Flow 'volume_create_manager' (744e3bbf-9b19-47d9-88fd-015ad2b8fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d679887-d0c9-454e-9e85-cf05a97888f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d679887-d0c9-454e-9e85-cf05a97888f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-457014543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84939f50-bd56-4dc6-8513-3acce744b872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dc83cafcb34337922cf9021f5ae75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:46Z,use_quota=True,user_id='b80eb32351e3495fa1761aa2e498b582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a67ea1-aba8-40ae-9ca9-8cb8ef6ce13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a67ea1-aba8-40ae-9ca9-8cb8ef6ce13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb652e6-fbeb-4c1b-9896-0bd3d0a54cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb652e6-fbeb-4c1b-9896-0bd3d0a54cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84939f50-bd56-4dc6-8513-3acce744b872', 'volume_name': 'volume-84939f50-bd56-4dc6-8513-3acce744b872', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837ba26f-7da5-4608-bf47-69bf001b0b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837ba26f-7da5-4608-bf47-69bf001b0b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6635ed-520b-4ba8-8f5b-74e75cabc636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:46 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Volume 84939f50-bd56-4dc6-8513-3acce744b872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84939f50-bd56-4dc6-8513-3acce744b872', 'volume_size': 1} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:46 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b 1073741824" returned: 0 in 0.411s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:46 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b Nov 05 22:31:46 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:47 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b" returned: 0 in 0.245s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.485s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-457014543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84939f50-bd56-4dc6-8513-3acce744b872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dc83cafcb34337922cf9021f5ae75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:46Z,use_quota=True,user_id='b80eb32351e3495fa1761aa2e498b582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Creating volume 84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:47 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f6312f-cb96-42b5-9cce-3c30fe2c21c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:47 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 1073741824 Nov 05 22:31:47 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacc66e8-2217-423a-a064-e6ae4db2e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:47 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Volume volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b (0ee04a78-4509-421a-a3d9-b3775aec7f8b): created successfully Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacc66e8-2217-423a-a064-e6ae4db2e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (4a1caf03-4615-4523-8c39-04a645fee2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8b6c1fb0-7a2a-46b6-83b8-71491a73359a tempest-ProjectReaderTests-18200761 None] Created volume successfully. Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-0ee04a78-4509-421a-a3d9-b3775aec7f8b-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Lock "cinder-0ee04a78-4509-421a-a3d9-b3775aec7f8b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-quobyte-0ee04a78-4509-421a-a3d9-b3775aec7f8b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-0ee04a78-4509-421a-a3d9-b3775aec7f8b" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f1a705-ce2c-4247-8252-28a680f9958f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:47 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 1073741824" returned: 0 in 0.517s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:47 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b Nov 05 22:31:47 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:47 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 Nov 05 22:31:47 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:47 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872" returned: 0 in 0.241s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6635ed-520b-4ba8-8f5b-74e75cabc636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84939f50-bd56-4dc6-8513-3acce744b872', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340cd25f-bb05-4205-bc96-a42ee9d185a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:47 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Volume volume-84939f50-bd56-4dc6-8513-3acce744b872 (84939f50-bd56-4dc6-8513-3acce744b872): created successfully Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340cd25f-bb05-4205-bc96-a42ee9d185a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Flow 'volume_create_manager' (744e3bbf-9b19-47d9-88fd-015ad2b8fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1a5b6cf0-9339-49cf-9f3e-e9bbf1202e00 tempest-VolumeDependencyTests-938931772 None] Created volume successfully. Nov 05 22:31:47 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b" returned: 0 in 0.406s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:47 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b Nov 05 22:31:48 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:48 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0ee04a78-4509-421a-a3d9-b3775aec7f8b" returned: 0 in 0.248s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-0ee04a78-4509-421a-a3d9-b3775aec7f8b" released by "delete_volume" :: held 0.695s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Created reservations ['84bb6f7e-c8d8-4433-b225-9718c6de9f93', '55b8104a-3db9-443b-968f-cae075548289', '4bbfcbd1-4d1f-483f-bcbb-367ff2a04ec0', '6a5cc197-a101-40d8-b5ea-493177647257'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:48 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:48 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:48 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.250s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:48 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Deleted volume successfully. Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b7c6b6b-b4f2-49fc-aa91-5d9856abb400 tempest-ProjectReaderTests-18200761 None] Lock "cinder-0ee04a78-4509-421a-a3d9-b3775aec7f8b-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Creating offline snapshot 0752f3f0-1637-4f74-8641-f95cc8a85e98 of volume 84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b584d1d4-8e03-4c55-a5ed-32972a123e97]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:48 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 Nov 05 22:31:48 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (85a930b7-1d37-4135-bf8b-c70e2029d81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8682d9a-1bb9-41e7-a224-7357bc36c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8682d9a-1bb9-41e7-a224-7357bc36c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729917246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48ad9a-8cff-4386-8550-f542d7cc14e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:49Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6b79ab-a767-495f-98d4-5ccfe428bfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6b79ab-a767-495f-98d4-5ccfe428bfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d232cc1e-4394-4b69-970b-6927db1cf218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d232cc1e-4394-4b69-970b-6927db1cf218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f48ad9a-8cff-4386-8550-f542d7cc14e1', 'volume_name': 'volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669808dc-8d73-48f7-a2ca-ec1894a10ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669808dc-8d73-48f7-a2ca-ec1894a10ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a98c21b-ebf4-484c-ab3e-c1fba84d813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Volume 4f48ad9a-8cff-4386-8550-f542d7cc14e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1', 'volume_size': 1} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:49 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872" returned: 0 in 0.392s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:49 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 1G Nov 05 22:31:49 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:49 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 1G" returned: 0 in 0.379s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84939f50-bd56-4dc6-8513-3acce744b872 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:49 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84939f50-bd56-4dc6-8513-3acce744b872 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 Nov 05 22:31:49 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:49 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84939f50-bd56-4dc6-8513-3acce744b872 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98" returned: 0 in 0.290s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:49 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 is being set with open permissions: ugo+rw Nov 05 22:31:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:49 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 Nov 05 22:31:49 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:50 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98" returned: 0 in 0.247s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:50 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.info Nov 05 22:31:50 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:50 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.info" returned: 0 in 0.249s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:50 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.info is being set with open permissions: ugo+rw Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:50 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.info Nov 05 22:31:50 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:50 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.info" returned: 0 in 0.251s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.508s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729917246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48ad9a-8cff-4386-8550-f542d7cc14e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:49Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Creating volume 4f48ad9a-8cff-4386-8550-f542d7cc14e1 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:50 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:50 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 1073741824 Nov 05 22:31:50 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ee66353e-1e27-4ba4-baeb-7b922c363018 tempest-VolumeDependencyTests-938931772 None] Create snapshot completed successfully Nov 05 22:31:51 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 1073741824" returned: 0 in 0.472s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:51 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 Nov 05 22:31:51 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:51 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1" returned: 0 in 0.252s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a98c21b-ebf4-484c-ab3e-c1fba84d813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745be897-6b84-43f2-b3ca-72473bfb68c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Flow 'volume_create_manager' (b9219f3a-b793-44c8-8e56-76867f738ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9816b91e-e6a9-44b6-96aa-f30e960fe026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Volume volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 (4f48ad9a-8cff-4386-8550-f542d7cc14e1): created successfully Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745be897-6b84-43f2-b3ca-72473bfb68c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (85a930b7-1d37-4135-bf8b-c70e2029d81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9816b91e-e6a9-44b6-96aa-f30e960fe026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-172441786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf82029-d149-4f11-8bdc-51e8f0561156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dc83cafcb34337922cf9021f5ae75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0752f3f0-1637-4f74-8641-f95cc8a85e98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:51Z,use_quota=True,user_id='b80eb32351e3495fa1761aa2e498b582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a373434-bcc7-49e1-90de-40581c9cbfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a373434-bcc7-49e1-90de-40581c9cbfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5fa1cf-0c03-4842-a962-716df1a103ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc5fa1cf-0c03-4842-a962-716df1a103ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bf82029-d149-4f11-8bdc-51e8f0561156', 'volume_name': 'volume-7bf82029-d149-4f11-8bdc-51e8f0561156', 'volume_size': 1, 'snapshot_id': '0752f3f0-1637-4f74-8641-f95cc8a85e98'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7e1f15-1058-4c01-9392-3135d64b221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7e1f15-1058-4c01-9392-3135d64b221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d42930-f34d-4d86-a182-9b0e78516689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Volume 7bf82029-d149-4f11-8bdc-51e8f0561156: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bf82029-d149-4f11-8bdc-51e8f0561156', 'volume_size': 1, 'snapshot_id': '0752f3f0-1637-4f74-8641-f95cc8a85e98'} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-quobyte-0752f3f0-1637-4f74-8641-f95cc8a85e98-7bf82029-d149-4f11-8bdc-51e8f0561156" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4989c435-9b8c-4d8f-b277-6a5d2b6f3e56 tempest-ProjectReaderTests-18200761 None] Created volume successfully. Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-0752f3f0-1637-4f74-8641-f95cc8a85e98-7bf82029-d149-4f11-8bdc-51e8f0561156" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Creating volume 7bf82029-d149-4f11-8bdc-51e8f0561156 from snapshot 0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-quobyte-7bf82029-d149-4f11-8bdc-51e8f0561156" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-7bf82029-d149-4f11-8bdc-51e8f0561156" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] snapshot: 0752f3f0-1637-4f74-8641-f95cc8a85e98, volume: 7bf82029-d149-4f11-8bdc-51e8f0561156, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb63543-3987-4d61-93c1-8928f1d69344]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:51 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 Nov 05 22:31:51 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:52 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98" returned: 0 in 0.347s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84939f50-bd56-4dc6-8513-3acce744b872(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f6defd-ccd9-4d5a-ae7c-f2a231eab700]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:52 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 Nov 05 22:31:52 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-4f48ad9a-8cff-4386-8550-f542d7cc14e1-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Lock "cinder-4f48ad9a-8cff-4386-8550-f542d7cc14e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-quobyte-4f48ad9a-8cff-4386-8550-f542d7cc14e1" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-4f48ad9a-8cff-4386-8550-f542d7cc14e1" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a66721e-d5e0-40f0-a64d-00e2273f28b8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:52 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872" returned: 0 in 0.433s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:52 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 Nov 05 22:31:52 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:52 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 Nov 05 22:31:52 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:52 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1" returned: 0 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:52 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1 Nov 05 22:31:52 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:53 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4f48ad9a-8cff-4386-8550-f542d7cc14e1" returned: 0 in 0.302s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-4f48ad9a-8cff-4386-8550-f542d7cc14e1" released by "delete_volume" :: held 0.742s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Created reservations ['148f43cd-67d9-4da9-862f-ec965dba609a', 'cf9d84a4-55b3-46ec-8a1c-a6c7aa4719de', 'c0142703-6d96-4184-9ffd-8550a98cc07c', '8ffdd3ce-cb4e-4e8f-94ac-80fcb167710e'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:53 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:31:53 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:53 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.477s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:31:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Deleted volume successfully. Nov 05 22:31:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e43dce73-ec12-44d6-8e82-2e7d18626449 tempest-ProjectReaderTests-18200761 None] Lock "cinder-4f48ad9a-8cff-4386-8550-f542d7cc14e1-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (8f8aec69-6171-467e-abd3-faf3a70b75dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd0d6d5-9ecb-4c88-bafe-f9cfaf642485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd0d6d5-9ecb-4c88-bafe-f9cfaf642485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077434756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57744b5-9139-4aed-98c6-eca7d9d4a3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:54Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb2b538-7c3f-47f3-9810-33a48ca37c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb2b538-7c3f-47f3-9810-33a48ca37c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41571cb2-c146-4a56-88f4-257ffbc877db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41571cb2-c146-4a56-88f4-257ffbc877db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57744b5-9139-4aed-98c6-eca7d9d4a3a6', 'volume_name': 'volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e021befb-857c-452c-a744-369ccdb6219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e021befb-857c-452c-a744-369ccdb6219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e381a36-f6cd-417a-b6dd-2158895a0925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Volume d57744b5-9139-4aed-98c6-eca7d9d4a3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6', 'volume_size': 1} Nov 05 22:31:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:58 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156" returned: 0 in 6.514s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:31:59 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Converted 1024.00 MB image at 157.19 MB/s Nov 05 22:31:59 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 is being set with open permissions: ugo+rw Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:59 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 Nov 05 22:31:59 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:59 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156" returned: 0 in 0.238s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-7bf82029-d149-4f11-8bdc-51e8f0561156" released by "_copy_volume_from_snapshot" :: held 7.616s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-0752f3f0-1637-4f74-8641-f95cc8a85e98-7bf82029-d149-4f11-8bdc-51e8f0561156" released by "_create_volume_from_snapshot" :: held 7.677s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.696s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.645s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077434756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57744b5-9139-4aed-98c6-eca7d9d4a3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:31:54Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Creating volume d57744b5-9139-4aed-98c6-eca7d9d4a3a6 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:31:59 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:59 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 1073741824 Nov 05 22:31:59 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d42930-f34d-4d86-a182-9b0e78516689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf82029-d149-4f11-8bdc-51e8f0561156', 'volume_size': 1, 'snapshot_id': '0752f3f0-1637-4f74-8641-f95cc8a85e98'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567c2a28-21cc-47a4-981c-40d97485fe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:31:59 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Volume volume-7bf82029-d149-4f11-8bdc-51e8f0561156 (7bf82029-d149-4f11-8bdc-51e8f0561156): created successfully Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567c2a28-21cc-47a4-981c-40d97485fe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Flow 'volume_create_manager' (b9219f3a-b793-44c8-8e56-76867f738ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:31:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8e591a48-dda4-4c0b-bd86-b2f612cc80bc tempest-VolumeDependencyTests-938931772 None] Created volume successfully. Nov 05 22:31:59 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 1073741824" returned: 0 in 0.418s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:31:59 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 Nov 05 22:31:59 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:31:59 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6" returned: 0 in 0.246s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:31:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e381a36-f6cd-417a-b6dd-2158895a0925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca3c2d6-6f4d-4a6c-9a2d-baa42b7d472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:00 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Volume volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 (d57744b5-9139-4aed-98c6-eca7d9d4a3a6): created successfully Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca3c2d6-6f4d-4a6c-9a2d-baa42b7d472f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (8f8aec69-6171-467e-abd3-faf3a70b75dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ad40b73f-8753-41f8-b010-227fd1fa156e tempest-ProjectReaderTests-18200761 None] Created volume successfully. Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-0752f3f0-1637-4f74-8641-f95cc8a85e98-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Lock "cinder-0752f3f0-1637-4f74-8641-f95cc8a85e98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-quobyte-84939f50-bd56-4dc6-8513-3acce744b872" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-84939f50-bd56-4dc6-8513-3acce744b872" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-quobyte-0752f3f0-1637-4f74-8641-f95cc8a85e98" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-0752f3f0-1637-4f74-8641-f95cc8a85e98" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Deleting offline snapshot 0752f3f0-1637-4f74-8641-f95cc8a85e98 of volume 84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] snapshot_file for this snap is: volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[04003cf3-2c3d-4b6f-95cc-99eb21aa20e4]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:00 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 Nov 05 22:32:00 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:00 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98" returned: 0 in 0.349s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84939f50-bd56-4dc6-8513-3acce744b872(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[53136341-020e-4eb9-97e1-c5efbb19aea3]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:00 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 Nov 05 22:32:00 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-d57744b5-9139-4aed-98c6-eca7d9d4a3a6-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Lock "cinder-d57744b5-9139-4aed-98c6-eca7d9d4a3a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-quobyte-d57744b5-9139-4aed-98c6-eca7d9d4a3a6" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-d57744b5-9139-4aed-98c6-eca7d9d4a3a6" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[81730ba4-755e-4c1e-95a5-46f8e7dfc9f3]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:01 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872" returned: 0 in 0.557s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:01 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 Nov 05 22:32:01 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:01 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 Nov 05 22:32:01 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:01 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98" returned: 0 in 0.329s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:01 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98 Nov 05 22:32:01 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:01 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:01 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6 Nov 05 22:32:01 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:01 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872.0752f3f0-1637-4f74-8641-f95cc8a85e98" returned: 0 in 0.255s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:01 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d57744b5-9139-4aed-98c6-eca7d9d4a3a6" returned: 0 in 0.251s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-0752f3f0-1637-4f74-8641-f95cc8a85e98" released by "_delete_snapshot" :: held 1.594s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-d57744b5-9139-4aed-98c6-eca7d9d4a3a6" released by "delete_volume" :: held 0.683s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-84939f50-bd56-4dc6-8513-3acce744b872" released by "delete_snapshot" :: held 1.620s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Created reservations ['025be9a5-087f-48d5-afcb-1574b7d795b9', 'e1314152-2472-4997-8e8f-07416e9879a3', '3ced22ac-daf3-4eb3-9e0d-4837a1c83e1e', '85a31bbe-1949-4a14-b0a7-e946c00d0a68'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Created reservations ['322867cc-a43a-463c-8f8c-20c2ef136364', 'b138ccec-9628-438a-b0da-8e333346c80e', 'cb0f1b40-816d-40ee-90f3-14794ef73400', 'c8c9bf4f-d87a-48db-a905-439024ea26bf'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:01 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:32:01 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Delete snapshot completed successfully. Nov 05 22:32:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-66d93cb0-c2ca-4607-a37e-ff69abcb5043 tempest-VolumeDependencyTests-938931772 None] Lock "cinder-0752f3f0-1637-4f74-8641-f95cc8a85e98-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:02 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.253s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Deleted volume successfully. Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c45ec44-c791-48dd-8c06-413eb10f6c57 tempest-ProjectReaderTests-18200761 None] Lock "cinder-d57744b5-9139-4aed-98c6-eca7d9d4a3a6-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-84939f50-bd56-4dc6-8513-3acce744b872-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Lock "cinder-84939f50-bd56-4dc6-8513-3acce744b872-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-quobyte-84939f50-bd56-4dc6-8513-3acce744b872" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-84939f50-bd56-4dc6-8513-3acce744b872" acquired by "delete_volume" :: waited 0.013s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[753bb53f-b590-48c6-93bf-f6513bda776b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:02 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 Nov 05 22:32:02 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (15c408cf-feb4-4bde-a6c7-30e3962aaf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c865c50-2c9d-4e83-a363-ad10199f66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c865c50-2c9d-4e83-a363-ad10199f66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319642913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:32:03Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d58680b-fae0-4b24-adaa-2eaefc4aff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d58680b-fae0-4b24-adaa-2eaefc4aff8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfc3a18-a0ea-4958-b5d2-28793c249a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfc3a18-a0ea-4958-b5d2-28793c249a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec', 'volume_name': 'volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773e4d6c-f0d7-43cc-badc-8b60bccd4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773e4d6c-f0d7-43cc-badc-8b60bccd4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26c7d88-8c08-4eec-96a1-2075ed62617b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Volume 0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec', 'volume_size': 1} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319642913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fd4c2060c24d5382f3c2bfae918289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:32:03Z,use_quota=True,user_id='820d28593b4a49fd933a9b38a1d3234d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Creating volume 0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:32:02 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:02 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872" returned: 0 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:02 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec 1073741824 Nov 05 22:32:02 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:02 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872 Nov 05 22:32:02 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:03 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-84939f50-bd56-4dc6-8513-3acce744b872" returned: 0 in 0.246s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-84939f50-bd56-4dc6-8513-3acce744b872" released by "delete_volume" :: held 0.697s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Created reservations ['ec61703d-85a9-45e1-98ce-f4c3bb44a2f9', '7769e287-b559-44dd-9a2d-df0986828bc1', 'fcba2161-7e37-4917-9bac-fa45964cc0a1', '07994993-8181-4bec-8841-1fdd0292574d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:03 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:32:03 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:03 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec 1073741824" returned: 0 in 0.437s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:03 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec Nov 05 22:32:03 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:03 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.267s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-7bf82029-d149-4f11-8bdc-51e8f0561156-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Deleted volume successfully. Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Lock "cinder-7bf82029-d149-4f11-8bdc-51e8f0561156-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9b94a49b-9200-44ba-a767-a03a33afb55e tempest-VolumeDependencyTests-938931772 None] Lock "cinder-84939f50-bd56-4dc6-8513-3acce744b872-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:03 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec" returned: 0 in 0.285s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Acquiring lock "cinder-quobyte-7bf82029-d149-4f11-8bdc-51e8f0561156" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26c7d88-8c08-4eec-96a1-2075ed62617b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b49b67d-3b85-4e5f-9128-ccde9f117fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-7bf82029-d149-4f11-8bdc-51e8f0561156" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:03 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Volume volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec (0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec): created successfully Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b49b67d-3b85-4e5f-9128-ccde9f117fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Flow 'volume_create_manager' (15c408cf-feb4-4bde-a6c7-30e3962aaf38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c901541e-7206-41e7-8cd9-9ba2982e488f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-abdd715a-e523-4180-82d0-ac4d2f50cbee tempest-ProjectReaderTests-18200761 None] Created volume successfully. Nov 05 22:32:03 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 Nov 05 22:32:03 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:03 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156" returned: 0 in 0.353s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:04 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156 Nov 05 22:32:04 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:04 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7bf82029-d149-4f11-8bdc-51e8f0561156" returned: 0 in 0.242s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Lock "cinder-quobyte-7bf82029-d149-4f11-8bdc-51e8f0561156" released by "delete_volume" :: held 0.650s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Created reservations ['3bf2ae04-a03f-4a42-a26e-7e34d3fb2273', '0a15b40d-f393-4b40-a16f-0000228e28f2', 'd7fe6413-74d8-4944-88a9-d073dc2b7278', 'c0f84985-1c85-463f-bf75-a6bf036e0469'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:04 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:32:04 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:04 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.248s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Deleted volume successfully. Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5a462a79-3c57-4f71-9aba-cdcad7a8247b tempest-VolumeDependencyTests-938931772 None] Lock "cinder-7bf82029-d149-4f11-8bdc-51e8f0561156-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Lock "cinder-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Acquiring lock "cinder-quobyte-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b2c90-786d-4539-ab74-21f2160c2d8e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:05 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec Nov 05 22:32:05 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:05 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec" returned: 0 in 0.425s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:05 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec Nov 05 22:32:05 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:05 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec" returned: 0 in 0.268s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Lock "cinder-quobyte-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec" released by "delete_volume" :: held 0.745s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Created reservations ['7e80cd46-b294-4900-a637-1bb9109b7edf', '3a96450f-676e-46ba-b5f4-1b63275a5130', '5a36349e-1913-4ce2-ad00-92bb525220a2', 'e66cea4a-f901-4274-8f36-86217cd65b3c'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:05 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:32:05 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:06 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:06 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Deleted volume successfully. Nov 05 22:32:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fdfd280c-689e-4325-8659-eca2cddac781 tempest-ProjectReaderTests-18200761 None] Lock "cinder-0b2ecca6-90b8-4cd3-9ed1-1f65066bb3ec-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:15 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=49,cinder:UPDATE=82,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:32:16 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=53,cinder:UPDATE=62,cinder:DELETE=8,cinder:INSERT=16 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Flow 'volume_create_manager' (baaaf04f-5904-47f9-a453-ba928e20529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331ed5f7-fa28-47f6-b189-5db6ef8b23de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331ed5f7-fa28-47f6-b189-5db6ef8b23de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1714150972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ab464d-53e0-427e-9b38-1fa391bd8c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ef6cd3f490474b8303fb16b7ff5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:32:26Z,use_quota=True,user_id='02099890a82f4290ad06f0f86a0e2fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8b635b-a36d-4f70-b060-7c80d167c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8b635b-a36d-4f70-b060-7c80d167c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42bff3b-ecc6-4ab8-923e-daaf905f3da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42bff3b-ecc6-4ab8-923e-daaf905f3da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ab464d-53e0-427e-9b38-1fa391bd8c8b', 'volume_name': 'volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931b4ad5-4fbf-4885-87f0-b504b9c52bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931b4ad5-4fbf-4885-87f0-b504b9c52bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae699dab-8544-4add-942f-9b6f047b7332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:25 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Volume 88ab464d-53e0-427e-9b38-1fa391bd8c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b', 'volume_size': 1} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1714150972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ab464d-53e0-427e-9b38-1fa391bd8c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ef6cd3f490474b8303fb16b7ff5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:32:26Z,use_quota=True,user_id='02099890a82f4290ad06f0f86a0e2fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Creating volume 88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:32:25 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:32:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:25 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b 1073741824 Nov 05 22:32:25 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:26 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b 1073741824" returned: 0 in 0.404s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:26 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b Nov 05 22:32:26 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:26 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b" returned: 0 in 0.245s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae699dab-8544-4add-942f-9b6f047b7332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ad400-59ad-44f7-b696-0aa177f53a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:26 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Volume volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b (88ab464d-53e0-427e-9b38-1fa391bd8c8b): created successfully Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61ad400-59ad-44f7-b696-0aa177f53a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Flow 'volume_create_manager' (baaaf04f-5904-47f9-a453-ba928e20529a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b57ff064-c862-4d15-a07b-38178514c653 tempest-SnapshotDependencyTests-1118070816 None] Created volume successfully. Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Creating offline snapshot 7eac0d6f-c863-4bf1-b622-8e60196dff2c of volume 88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:32:27 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e073cd3a-5af7-4afa-b06b-0121e276e24b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:27 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b Nov 05 22:32:27 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:27 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:27 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c 1G Nov 05 22:32:27 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:27 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c 1G" returned: 0 in 0.376s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:27 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c Nov 05 22:32:27 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:28 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c" returned: 0 in 0.295s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:28 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c is being set with open permissions: ugo+rw Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:28 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c Nov 05 22:32:28 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:28 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:28 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.info Nov 05 22:32:28 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:28 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.info" returned: 0 in 0.254s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:28 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.info is being set with open permissions: ugo+rw Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:28 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.info Nov 05 22:32:28 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:28 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.info" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8ae99f40-547e-4b5a-971c-74860ee89f8f tempest-SnapshotDependencyTests-1118070816 None] Create snapshot completed successfully Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Flow 'volume_create_manager' (6f10bced-7c54-42d3-a3ba-ce6b07a3d211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6e7c73-262f-4a9f-8e69-e1484c45a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f6e7c73-262f-4a9f-8e69-e1484c45a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0188e92d-ba29-484f-8aee-180e2d0de402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ef6cd3f490474b8303fb16b7ff5061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7eac0d6f-c863-4bf1-b622-8e60196dff2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:32:30Z,use_quota=True,user_id='02099890a82f4290ad06f0f86a0e2fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c392d7e-9516-44f5-a744-31677fe54366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c392d7e-9516-44f5-a744-31677fe54366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b667d6-c51d-4913-9b99-9005a7940fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b667d6-c51d-4913-9b99-9005a7940fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0188e92d-ba29-484f-8aee-180e2d0de402', 'volume_name': 'volume-0188e92d-ba29-484f-8aee-180e2d0de402', 'volume_size': 1, 'snapshot_id': '7eac0d6f-c863-4bf1-b622-8e60196dff2c'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73758cb1-4c73-4918-a753-6e4afc05f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73758cb1-4c73-4918-a753-6e4afc05f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633e2c41-1a9f-4f66-bfca-aa8fa1daa660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:29 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Volume 0188e92d-ba29-484f-8aee-180e2d0de402: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0188e92d-ba29-484f-8aee-180e2d0de402', 'volume_size': 1, 'snapshot_id': '7eac0d6f-c863-4bf1-b622-8e60196dff2c'} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-quobyte-7eac0d6f-c863-4bf1-b622-8e60196dff2c-0188e92d-ba29-484f-8aee-180e2d0de402" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-7eac0d6f-c863-4bf1-b622-8e60196dff2c-0188e92d-ba29-484f-8aee-180e2d0de402" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Creating volume 0188e92d-ba29-484f-8aee-180e2d0de402 from snapshot 7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-quobyte-0188e92d-ba29-484f-8aee-180e2d0de402" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-0188e92d-ba29-484f-8aee-180e2d0de402" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] snapshot: 7eac0d6f-c863-4bf1-b622-8e60196dff2c, volume: 0188e92d-ba29-484f-8aee-180e2d0de402, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b4b48f-d637-48a1-af5b-7c05fbfd2667]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:29 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c Nov 05 22:32:29 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:30 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b1b01-6441-4c99-b3a9-eafeb00733cd]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:30 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b Nov 05 22:32:30 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:30 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b" returned: 0 in 0.356s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:32:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:30 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 Nov 05 22:32:30 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:36 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402" returned: 0 in 5.917s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:32:36 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Converted 1024.00 MB image at 173.01 MB/s Nov 05 22:32:36 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 is being set with open permissions: ugo+rw Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:36 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 Nov 05 22:32:36 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:36 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402" returned: 0 in 0.228s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-0188e92d-ba29-484f-8aee-180e2d0de402" released by "_copy_volume_from_snapshot" :: held 6.920s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-7eac0d6f-c863-4bf1-b622-8e60196dff2c-0188e92d-ba29-484f-8aee-180e2d0de402" released by "_create_volume_from_snapshot" :: held 6.982s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.996s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633e2c41-1a9f-4f66-bfca-aa8fa1daa660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0188e92d-ba29-484f-8aee-180e2d0de402', 'volume_size': 1, 'snapshot_id': '7eac0d6f-c863-4bf1-b622-8e60196dff2c'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec74917e-4b1b-4b57-8b42-6c3754df164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:32:36 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Volume volume-0188e92d-ba29-484f-8aee-180e2d0de402 (0188e92d-ba29-484f-8aee-180e2d0de402): created successfully Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec74917e-4b1b-4b57-8b42-6c3754df164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:32:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Flow 'volume_create_manager' (6f10bced-7c54-42d3-a3ba-ce6b07a3d211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:32:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cf390431-df3d-4511-b8e4-3632d1024a3f tempest-SnapshotDependencyTests-1118070816 None] Created volume successfully. Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-7eac0d6f-c863-4bf1-b622-8e60196dff2c-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-7eac0d6f-c863-4bf1-b622-8e60196dff2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-quobyte-88ab464d-53e0-427e-9b38-1fa391bd8c8b" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-88ab464d-53e0-427e-9b38-1fa391bd8c8b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-quobyte-7eac0d6f-c863-4bf1-b622-8e60196dff2c" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-7eac0d6f-c863-4bf1-b622-8e60196dff2c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Deleting offline snapshot 7eac0d6f-c863-4bf1-b622-8e60196dff2c of volume 88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] snapshot_file for this snap is: volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[317458c9-8177-48c1-931e-d98782bbd55c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:37 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c Nov 05 22:32:37 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:37 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4156da4-bd79-41cd-93e1-97af1ed6da0e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:38 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b Nov 05 22:32:38 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:38 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b" returned: 0 in 0.528s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:38 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c Nov 05 22:32:38 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:38 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c" returned: 0 in 0.326s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:38 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c Nov 05 22:32:38 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:39 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b.7eac0d6f-c863-4bf1-b622-8e60196dff2c" returned: 0 in 0.239s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-7eac0d6f-c863-4bf1-b622-8e60196dff2c" released by "_delete_snapshot" :: held 1.537s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-88ab464d-53e0-427e-9b38-1fa391bd8c8b" released by "delete_snapshot" :: held 1.559s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Created reservations ['8adfa675-644c-4b41-8de5-bb998bf84c82', 'cea9390c-317a-4144-8776-bf776deb3ec4', '3d74d12c-ab59-4448-98eb-ef853957ab86', '883b1cda-800e-454b-af29-3afbf8cec9b4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Delete snapshot completed successfully. Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-640785fa-0f19-473f-843c-b80ae086fcc0 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-7eac0d6f-c863-4bf1-b622-8e60196dff2c-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-88ab464d-53e0-427e-9b38-1fa391bd8c8b-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-88ab464d-53e0-427e-9b38-1fa391bd8c8b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-quobyte-88ab464d-53e0-427e-9b38-1fa391bd8c8b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-88ab464d-53e0-427e-9b38-1fa391bd8c8b" acquired by "delete_volume" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670c0b3-a4b5-4fe1-bedd-6de145ec9f50]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:39 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b Nov 05 22:32:39 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:40 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b" returned: 0 in 0.356s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:40 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b Nov 05 22:32:40 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:40 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:32:40 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:40 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-88ab464d-53e0-427e-9b38-1fa391bd8c8b" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-88ab464d-53e0-427e-9b38-1fa391bd8c8b" released by "delete_volume" :: held 0.665s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Created reservations ['d7eecfb5-6208-4ed9-beb8-74b1d1a80825', '23d130b3-23fc-4809-8a08-f543f26e63d2', 'b84de335-cc36-4319-aa8b-f0f087361131', '5b1b87dd-95eb-4fa5-94ad-e41e3a842d5f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:40 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:32:40 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:40 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.260s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:32:40 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.240s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Deleted volume successfully. Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8d794f4e-b01e-4ca7-9618-f195c98f1eb3 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-88ab464d-53e0-427e-9b38-1fa391bd8c8b-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-0188e92d-ba29-484f-8aee-180e2d0de402-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-0188e92d-ba29-484f-8aee-180e2d0de402-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "cinder-quobyte-0188e92d-ba29-484f-8aee-180e2d0de402" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-0188e92d-ba29-484f-8aee-180e2d0de402" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[81597e15-20df-48e2-be44-93ef48e8df34]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:32:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:40 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 Nov 05 22:32:40 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:41 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:41 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402 Nov 05 22:32:41 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:41 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0188e92d-ba29-484f-8aee-180e2d0de402" returned: 0 in 0.242s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-quobyte-0188e92d-ba29-484f-8aee-180e2d0de402" released by "delete_volume" :: held 0.636s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Created reservations ['18d5853e-3e5f-4023-9148-a095e7b99363', 'e1c4d302-a2b6-42d5-876d-703cfafd1573', '6812bd1a-c6af-4a95-8ba6-fd3ec48a8f1b', 'f7fe61d7-8065-472c-bc3e-aa76c0a8b3a4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:32:41 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:32:41 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:32:41 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.239s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:32:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Deleted volume successfully. Nov 05 22:32:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e4423267-00c8-45e2-a488-21e136338667 tempest-SnapshotDependencyTests-1118070816 None] Lock "cinder-0188e92d-ba29-484f-8aee-180e2d0de402-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:32:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:INSERT=6 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:32:51 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=5,cinder:SELECT=21 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (04a0292a-1ba2-4281-a173-6304993408c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e982139f-8bac-4730-a9be-81ed3fb25d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e982139f-8bac-4730-a9be-81ed3fb25d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351188769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38f658b-618a-42ef-8259-96d295184cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:02Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09612fba-e9f3-4723-8b81-2fab46cb1ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09612fba-e9f3-4723-8b81-2fab46cb1ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29b02b9-da7c-4ba0-a7b5-51aed15983e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29b02b9-da7c-4ba0-a7b5-51aed15983e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38f658b-618a-42ef-8259-96d295184cbc', 'volume_name': 'volume-d38f658b-618a-42ef-8259-96d295184cbc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42bb5a-b1b6-48ad-9572-2efb29d1e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a42bb5a-b1b6-48ad-9572-2efb29d1e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7858ee6-32b0-409e-a863-b78181eac8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume d38f658b-618a-42ef-8259-96d295184cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38f658b-618a-42ef-8259-96d295184cbc', 'volume_size': 1} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351188769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38f658b-618a-42ef-8259-96d295184cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:02Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Creating volume d38f658b-618a-42ef-8259-96d295184cbc {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:02 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:02 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc 1073741824 Nov 05 22:33:02 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Flow 'volume_create_manager' (c3b1f9a8-d5cd-46ff-93c6-62c7273b11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756205ea-3730-47e4-b337-f0a7d46de529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756205ea-3730-47e4-b337-f0a7d46de529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2032672381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c360a03ecb20461e88f83b986dce4a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:02Z,use_quota=True,user_id='efb7635fe3264c44a9d242dbd1936945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e05899d-561a-40fb-88b4-669cfe47cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e05899d-561a-40fb-88b4-669cfe47cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c344cb-75d1-4620-8697-6a6b686c3b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c344cb-75d1-4620-8697-6a6b686c3b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb', 'volume_name': 'volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c38d70-0447-46a8-94ee-49e2740cd396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c38d70-0447-46a8-94ee-49e2740cd396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81618e8c-cc17-42e3-ba02-fbd5edaa2d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Volume 81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb', 'volume_size': 1} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (b44190f0-4814-4c0c-a2d3-bac40819f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c781ce-35dc-4a49-98a6-2db03988c226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c781ce-35dc-4a49-98a6-2db03988c226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653555750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:03Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc416beb-fa67-4b91-8c67-5fd92d5d1403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc416beb-fa67-4b91-8c67-5fd92d5d1403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19a1a48-9acb-44d8-8af7-005ba252bc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19a1a48-9acb-44d8-8af7-005ba252bc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8', 'volume_name': 'volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5a9cc5-e7da-47e8-af06-4027d9f67a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5a9cc5-e7da-47e8-af06-4027d9f67a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f884379-0819-4976-8619-6dc7987548f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8', 'volume_size': 1} Nov 05 22:33:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:03 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc 1073741824" returned: 0 in 0.517s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:03 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc Nov 05 22:33:03 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:03 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2032672381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c360a03ecb20461e88f83b986dce4a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:02Z,use_quota=True,user_id='efb7635fe3264c44a9d242dbd1936945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Creating volume 81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:03 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7858ee6-32b0-409e-a863-b78181eac8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38f658b-618a-42ef-8259-96d295184cbc', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:03 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb 1073741824 Nov 05 22:33:03 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151802ba-99e0-4f88-be1b-66b092dd6fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:03 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume volume-d38f658b-618a-42ef-8259-96d295184cbc (d38f658b-618a-42ef-8259-96d295184cbc): created successfully Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151802ba-99e0-4f88-be1b-66b092dd6fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (04a0292a-1ba2-4281-a173-6304993408c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-def0c056-0500-48a2-97dc-07c62e751a4d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created volume successfully. Nov 05 22:33:03 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb 1073741824" returned: 0 in 0.440s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:03 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb Nov 05 22:33:03 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:04 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" returned: 0 in 0.246s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653555750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:03Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Creating volume fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:04 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81618e8c-cc17-42e3-ba02-fbd5edaa2d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:04 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 1073741824 Nov 05 22:33:04 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f09a8d0-06b7-42c1-a540-7fd8ed74120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:04 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Volume volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb (81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb): created successfully Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f09a8d0-06b7-42c1-a540-7fd8ed74120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Flow 'volume_create_manager' (c3b1f9a8-d5cd-46ff-93c6-62c7273b11fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-45e22f7c-19a1-4a35-b780-355d11200d63 tempest-VolumeDependencyTests-996594497 None] Created volume successfully. Nov 05 22:33:04 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 1073741824" returned: 0 in 0.571s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:04 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 Nov 05 22:33:04 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (057f8a29-759d-4b69-a870-9ffc168bbfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84099065-3f1c-4bcd-ad07-3f38f6ed5f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" returned: 0 in 0.337s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.276s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84099065-3f1c-4bcd-ad07-3f38f6ed5f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121362923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d92d584-0b12-4b3c-b794-1b15cb816feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:05Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4941ee-5d28-48a9-ba4f-367af994415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4941ee-5d28-48a9-ba4f-367af994415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a45f50-0aba-4d62-87b7-05b4b7b2168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a45f50-0aba-4d62-87b7-05b4b7b2168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d92d584-0b12-4b3c-b794-1b15cb816feb', 'volume_name': 'volume-0d92d584-0b12-4b3c-b794-1b15cb816feb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12eecfaf-13a9-4513-bf78-743713dd5dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12eecfaf-13a9-4513-bf78-743713dd5dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77939ede-0b5c-44ef-90bd-5f1125ae5415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume 0d92d584-0b12-4b3c-b794-1b15cb816feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d92d584-0b12-4b3c-b794-1b15cb816feb', 'volume_size': 1} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f884379-0819-4976-8619-6dc7987548f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adee32e-4b7e-443d-b415-b22b37b79c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Creating offline snapshot 9f9d188a-3a71-4a0d-9240-0983a9b2b710 of volume 81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:33:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 (fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8): created successfully Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adee32e-4b7e-443d-b415-b22b37b79c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (b44190f0-4814-4c0c-a2d3-bac40819f69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca0ad6-3a0c-4f82-bf59-1964bbfadecc]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:05 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e60c4c4d-0f81-4205-a2df-250e16a0269f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created volume successfully. Nov 05 22:33:05 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb Nov 05 22:33:05 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (ce8109f4-09dd-49cf-b678-e8239b703053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da030511-05a0-46fe-985d-2dc62dce8f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da030511-05a0-46fe-985d-2dc62dce8f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688702478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45568e91-6303-4276-9635-bb52f6c7e2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:05Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca720cd-6277-47ac-9f46-ca7d2ae0869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca720cd-6277-47ac-9f46-ca7d2ae0869a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e255d98-ccc3-40e4-ac83-379186848b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e255d98-ccc3-40e4-ac83-379186848b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45568e91-6303-4276-9635-bb52f6c7e2d4', 'volume_name': 'volume-45568e91-6303-4276-9635-bb52f6c7e2d4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfa1876-351d-48ab-bd0b-c39224cb8727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfa1876-351d-48ab-bd0b-c39224cb8727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6f5813-701e-4bb3-8847-40b2b6a8384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume 45568e91-6303-4276-9635-bb52f6c7e2d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45568e91-6303-4276-9635-bb52f6c7e2d4', 'volume_size': 1} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:05 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" returned: 0 in 0.415s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:05 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 1G Nov 05 22:33:05 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (9de38bc7-3ec1-47bf-b9cf-f5ae3edd65bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8bd23-0aea-44d9-9dda-e487c80c464e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc8bd23-0aea-44d9-9dda-e487c80c464e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132995832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5c06e6-30b4-4828-ad8b-92f59c8f7426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:06Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f22776-a22c-4639-a0e6-99642e4e1f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f22776-a22c-4639-a0e6-99642e4e1f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7a8e61-8aa6-4bdb-af62-5e2cf241f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7a8e61-8aa6-4bdb-af62-5e2cf241f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5c06e6-30b4-4828-ad8b-92f59c8f7426', 'volume_name': 'volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b1ad7f-513f-4490-a206-25e5cfb82db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b1ad7f-513f-4490-a206-25e5cfb82db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6056f2b-4704-4964-839b-a1407d86ed7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume 5d5c06e6-30b4-4828-ad8b-92f59c8f7426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426', 'volume_size': 1} Nov 05 22:33:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:06 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 1G" returned: 0 in 0.603s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:06 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 Nov 05 22:33:06 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Flow 'volume_create_manager' (0dbcc702-570e-4d16-82b5-c753ebd7ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b07bae0-07f7-49b0-8a46-fa91582abc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b07bae0-07f7-49b0-8a46-fa91582abc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77735ef3-f45b-4190-a9bd-567e45d7ff46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fa19f82d3db4a18b28a035f66f79cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:06Z,use_quota=True,user_id='0f5406d823124745a1f57b33bd2413c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(720bd103-8c78-4ab3-9b30-52e08e6d7bc1),volume_type_id=720bd103-8c78-4ab3-9b30-52e08e6d7bc1)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b24a09-0ab7-49dd-a39a-88855079b1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b24a09-0ab7-49dd-a39a-88855079b1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9270c504-f703-4aab-b5b9-3bb4fe1ea208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (6156e63c-fcdc-4c8f-a636-773082c36a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8287bbd-37df-468e-b80c-fe03d87bacce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8287bbd-37df-468e-b80c-fe03d87bacce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230361065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287aa411-f0b2-4e11-a321-de59b7efb58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:07Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dbda1d-b6d3-47ad-9039-1c88a9ee3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dbda1d-b6d3-47ad-9039-1c88a9ee3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481a3da9-9a6f-40f2-9616-3dcf387a19e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481a3da9-9a6f-40f2-9616-3dcf387a19e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287aa411-f0b2-4e11-a321-de59b7efb58c', 'volume_name': 'volume-287aa411-f0b2-4e11-a321-de59b7efb58c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1109208c-aae8-4bf9-a1c4-b0c9b62d253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1109208c-aae8-4bf9-a1c4-b0c9b62d253f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b761408-d10b-413d-b423-f31ba00af352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume 287aa411-f0b2-4e11-a321-de59b7efb58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287aa411-f0b2-4e11-a321-de59b7efb58c', 'volume_size': 1} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710" returned: 0 in 0.512s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:06 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 is being set with open permissions: ugo+rw Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:06 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 Nov 05 22:33:06 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (4efcbd42-4bfc-4861-965f-1cf9e9eb6378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a5ff74-fe04-401f-af5d-9c603c9603f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a5ff74-fe04-401f-af5d-9c603c9603f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337319128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d43c3e-1be1-4bc0-94bd-c977b59d3934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:07Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994b5f67-f08d-471d-82bd-8a8cb58a676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994b5f67-f08d-471d-82bd-8a8cb58a676b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230090d9-8816-4584-b14b-b81b4aa1d61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230090d9-8816-4584-b14b-b81b4aa1d61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d43c3e-1be1-4bc0-94bd-c977b59d3934', 'volume_name': 'volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2baae0a3-c566-426e-8d61-a777bd0bccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2baae0a3-c566-426e-8d61-a777bd0bccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e72611f-ce0d-4e49-99ac-ef54c812a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume d8d43c3e-1be1-4bc0-94bd-c977b59d3934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934', 'volume_size': 1} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9270c504-f703-4aab-b5b9-3bb4fe1ea208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77735ef3-f45b-4190-a9bd-567e45d7ff46', 'volume_name': 'volume-77735ef3-f45b-4190-a9bd-567e45d7ff46', 'volume_size': 1, 'image_id': 'a67cec57-1a73-466a-96cb-eb266e755f62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a67cec57-1a73-466a-96cb-eb266e755f62', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5c0e1b83d40a1f8598b0116412cd4ca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fa19f82d3db4a18b28a035f66f79cec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2b02ee4d95dc2380d37dfb762db882b94f61cdc5f785023f70d03d9dda3483995016fd37bd1469ed3366c35b42718ad52c5f0e034f9acb9b9118a444c88191', 'id': 'a67cec57-1a73-466a-96cb-eb266e755f62', 'created_at': datetime.datetime(2026, 11, 5, 21, 33, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 33, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a67cec57-1a73-466a-96cb-eb266e755f62/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9ad02-efc2-47bc-b392-e44d56103ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9ad02-efc2-47bc-b392-e44d56103ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e653a3-8808-4dc7-b836-88f075581ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:06 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Volume 77735ef3-f45b-4190-a9bd-567e45d7ff46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77735ef3-f45b-4190-a9bd-567e45d7ff46', 'volume_size': 1, 'image_id': 'a67cec57-1a73-466a-96cb-eb266e755f62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a67cec57-1a73-466a-96cb-eb266e755f62', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5c0e1b83d40a1f8598b0116412cd4ca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fa19f82d3db4a18b28a035f66f79cec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2b02ee4d95dc2380d37dfb762db882b94f61cdc5f785023f70d03d9dda3483995016fd37bd1469ed3366c35b42718ad52c5f0e034f9acb9b9118a444c88191', 'id': 'a67cec57-1a73-466a-96cb-eb266e755f62', 'created_at': datetime.datetime(2026, 11, 5, 21, 33, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 33, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a67cec57-1a73-466a-96cb-eb266e755f62/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 22:33:06 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Trying to clone 77735ef3-f45b-4190-a9bd-567e45d7ff46 from image a67cec57-1a73-466a-96cb-eb266e755f62 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a67cec57-1a73-466a-96cb-eb266e755f62', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:33:06 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710" returned: 0 in 0.283s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:07 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.info Nov 05 22:33:07 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:33:07 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8654d-332b-4689-82d3-fc164ddd23e8]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:07 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD Nov 05 22:33:07 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:07 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.info" returned: 0 in 0.264s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:07 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.info is being set with open permissions: ugo+rw Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:07 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.info Nov 05 22:33:07 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:07 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:07 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.info" returned: 0 in 0.248s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.471s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-121362923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d92d584-0b12-4b3c-b794-1b15cb816feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:05Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Creating volume 0d92d584-0b12-4b3c-b794-1b15cb816feb {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:07 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:07 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD Nov 05 22:33:07 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:07 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb 1073741824 Nov 05 22:33:07 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-14862081-6f89-4170-a4ac-166785ac1c3d tempest-VolumeDependencyTests-996594497 None] Create snapshot completed successfully Nov 05 22:33:07 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Temporary image a67cec57-1a73-466a-96cb-eb266e755f62 is fetched for user 0f5406d823124745a1f57b33bd2413c4. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6fb3fa-37c4-40fd-9421-83b124b75232]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:08 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD Nov 05 22:33:08 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:08 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb 1073741824" returned: 0 in 0.440s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:08 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb Nov 05 22:33:08 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:08 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:08 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.826s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688702478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45568e91-6303-4276-9635-bb52f6c7e2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:05Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Creating volume 45568e91-6303-4276-9635-bb52f6c7e2d4 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:08 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD Nov 05 22:33:08 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:08 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77939ede-0b5c-44ef-90bd-5f1125ae5415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d92d584-0b12-4b3c-b794-1b15cb816feb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:08 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 1073741824 Nov 05 22:33:08 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2425941e-9ecf-4beb-a3b1-28ce58f1f93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:08 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume volume-0d92d584-0b12-4b3c-b794-1b15cb816feb (0d92d584-0b12-4b3c-b794-1b15cb816feb): created successfully Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2425941e-9ecf-4beb-a3b1-28ce58f1f93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (057f8a29-759d-4b69-a870-9ffc168bbfed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-010be5d4-7520-416a-961f-6146ad8016b6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created volume successfully. Nov 05 22:33:08 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Flow 'volume_create_manager' (87300e6b-8c9d-4cf0-a71b-aab2aa97cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2de776-f444-45ef-b52c-5c837c33a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2de776-f444-45ef-b52c-5c837c33a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-458685188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a041d4-3974-4763-945a-54a27e283158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c360a03ecb20461e88f83b986dce4a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f9d188a-3a71-4a0d-9240-0983a9b2b710,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:09Z,use_quota=True,user_id='efb7635fe3264c44a9d242dbd1936945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14aa4838-2c2a-4059-9c6f-f39916c9eb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14aa4838-2c2a-4059-9c6f-f39916c9eb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d782ba-d425-443a-b865-dba16c9f6971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d782ba-d425-443a-b865-dba16c9f6971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69a041d4-3974-4763-945a-54a27e283158', 'volume_name': 'volume-69a041d4-3974-4763-945a-54a27e283158', 'volume_size': 1, 'snapshot_id': '9f9d188a-3a71-4a0d-9240-0983a9b2b710'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06030259-6d3f-4bf4-8020-40cf8ecbd2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06030259-6d3f-4bf4-8020-40cf8ecbd2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61db2165-72fc-4bfb-9bed-0558d9a77433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:08 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Volume 69a041d4-3974-4763-945a-54a27e283158: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69a041d4-3974-4763-945a-54a27e283158', 'volume_size': 1, 'snapshot_id': '9f9d188a-3a71-4a0d-9240-0983a9b2b710'} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:08 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 1073741824" returned: 0 in 0.512s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:08 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 Nov 05 22:33:08 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:09 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.192s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132995832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5c06e6-30b4-4828-ad8b-92f59c8f7426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:06Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Creating volume 5d5c06e6-30b4-4828-ad8b-92f59c8f7426 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:09 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6f5813-701e-4bb3-8847-40b2b6a8384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45568e91-6303-4276-9635-bb52f6c7e2d4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:09 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 1073741824 Nov 05 22:33:09 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ee3f99-62da-4697-9c41-73593f9d3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:09 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume volume-45568e91-6303-4276-9635-bb52f6c7e2d4 (45568e91-6303-4276-9635-bb52f6c7e2d4): created successfully Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ee3f99-62da-4697-9c41-73593f9d3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (ce8109f4-09dd-49cf-b678-e8239b703053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-04a8c7e2-564c-45d2-a4db-17e8b302a36d tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created volume successfully. Nov 05 22:33:09 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 1073741824" returned: 0 in 0.402s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:09 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 Nov 05 22:33:09 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:09 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426" returned: 0 in 0.249s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.162s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230361065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287aa411-f0b2-4e11-a321-de59b7efb58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:07Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Creating volume 287aa411-f0b2-4e11-a321-de59b7efb58c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:09 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6056f2b-4704-4964-839b-a1407d86ed7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:09 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c 1073741824 Nov 05 22:33:09 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85b448a-4c45-43e0-8afd-ec3555e1822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:09 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 (5d5c06e6-30b4-4828-ad8b-92f59c8f7426): created successfully Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85b448a-4c45-43e0-8afd-ec3555e1822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:09 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (9de38bc7-3ec1-47bf-b9cf-f5ae3edd65bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bed39809-8d80-4592-98f7-0fcf9aebca18 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created volume successfully. Nov 05 22:33:10 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c 1073741824" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:10 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c Nov 05 22:33:10 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:10 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.862s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Creating offline snapshot c472c19d-f589-492a-8cb1-d02d2d098a34 of volume fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33274b8-57a7-4a04-a8b2-936009fa7f7e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b761408-d10b-413d-b423-f31ba00af352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287aa411-f0b2-4e11-a321-de59b7efb58c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6422231-93ad-49b6-9956-5843e14c79b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume volume-287aa411-f0b2-4e11-a321-de59b7efb58c (287aa411-f0b2-4e11-a321-de59b7efb58c): created successfully Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6422231-93ad-49b6-9956-5843e14c79b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (6156e63c-fcdc-4c8f-a636-773082c36a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-57522d2c-cb23-4660-9c0b-2f365f00eb98 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created volume successfully. Nov 05 22:33:10 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 Nov 05 22:33:10 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:11 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" returned: 0 in 0.371s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:11 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 1G Nov 05 22:33:11 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:11 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 1G" returned: 0 in 0.402s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:11 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 Nov 05 22:33:11 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:11 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34" returned: 0 in 0.284s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:11 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 is being set with open permissions: ugo+rw Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:11 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 Nov 05 22:33:11 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:11 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34" returned: 0 in 0.249s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:12 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.info Nov 05 22:33:12 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:12 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.info" returned: 0 in 0.246s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:12 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.info is being set with open permissions: ugo+rw Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:12 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.info Nov 05 22:33:12 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:12 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.info" returned: 0 in 0.251s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.599s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337319128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d43c3e-1be1-4bc0-94bd-c977b59d3934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72636886c3e24268b9460cee67dc289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:07Z,use_quota=True,user_id='d9b7e87d0f744098adec7a15efd6832a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Creating volume d8d43c3e-1be1-4bc0-94bd-c977b59d3934 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:12 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:12 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 1073741824 Nov 05 22:33:12 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:12 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-54743851-f81b-4010-a3b7-0efa69c87890 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Create snapshot completed successfully Nov 05 22:33:12 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 1073741824" returned: 0 in 0.454s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:13 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 Nov 05 22:33:13 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (07620398-6af3-4eb6-9c2e-9a4309a2d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f79737-727e-4460-9429-4b6671c6cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f79737-727e-4460-9429-4b6671c6cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1078727342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8ee6c2-b041-4468-8387-a9b736f41ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:13Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d401edf-36d1-433d-bce4-cc6dae80073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d401edf-36d1-433d-bce4-cc6dae80073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033b629d-0828-4da0-9f65-8a92da24a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033b629d-0828-4da0-9f65-8a92da24a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8ee6c2-b041-4468-8387-a9b736f41ac7', 'volume_name': 'volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5803db5-0cd8-42f7-9315-cecd279b215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5803db5-0cd8-42f7-9315-cecd279b215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed575143-45f1-447d-ba9b-98ee671ec75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume 2b8ee6c2-b041-4468-8387-a9b736f41ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7', 'volume_size': 1} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934" returned: 0 in 0.371s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.737s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77735ef3-f45b-4190-a9bd-567e45d7ff46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fa19f82d3db4a18b28a035f66f79cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:06Z,use_quota=True,user_id='0f5406d823124745a1f57b33bd2413c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(720bd103-8c78-4ab3-9b30-52e08e6d7bc1),volume_type_id=720bd103-8c78-4ab3-9b30-52e08e6d7bc1)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Creating volume 77735ef3-f45b-4190-a9bd-567e45d7ff46 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:13 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e72611f-ce0d-4e49-99ac-ef54c812a43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7cfb22-708b-4be5-967c-a0d458e9e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 1073741824 Nov 05 22:33:13 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Volume volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 (d8d43c3e-1be1-4bc0-94bd-c977b59d3934): created successfully Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7cfb22-708b-4be5-967c-a0d458e9e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Flow 'volume_create_manager' (4efcbd42-4bfc-4861-965f-1cf9e9eb6378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-27300b30-52d6-4e7a-b150-83234fbc2c23 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created volume successfully. Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (be7ea0d6-a8e1-4026-becc-eb719db69b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407b3333-adfc-477c-a848-107c1a213860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407b3333-adfc-477c-a848-107c1a213860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507624739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=523fee88-10eb-409b-ba6f-ad7125c5da0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:14Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c55e7b1-d9bf-43ef-b236-4b41426f3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c55e7b1-d9bf-43ef-b236-4b41426f3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58b2fec-f785-49e5-834c-f49000b11986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58b2fec-f785-49e5-834c-f49000b11986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '523fee88-10eb-409b-ba6f-ad7125c5da0f', 'volume_name': 'volume-523fee88-10eb-409b-ba6f-ad7125c5da0f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc43cd51-2b2b-457e-9ee3-9108c42a026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc43cd51-2b2b-457e-9ee3-9108c42a026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3b5941-8ff5-4d84-a945-caf4f2b28954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume 523fee88-10eb-409b-ba6f-ad7125c5da0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-523fee88-10eb-409b-ba6f-ad7125c5da0f', 'volume_size': 1} Nov 05 22:33:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:14 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 1073741824" returned: 0 in 0.631s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (b9e3d6bb-7e49-4370-81c7-52a5d840abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:14 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 Nov 05 22:33:14 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b814c8b-fd04-4285-8503-7412ef3785e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b814c8b-fd04-4285-8503-7412ef3785e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122484781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319086ca-13ee-4920-ba5d-323321eee1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:14Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c06bbc2-b73b-45a4-afe8-0988056526d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c06bbc2-b73b-45a4-afe8-0988056526d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23642b0-5a65-4fcd-8713-53d23ea76304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23642b0-5a65-4fcd-8713-53d23ea76304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319086ca-13ee-4920-ba5d-323321eee1ca', 'volume_name': 'volume-319086ca-13ee-4920-ba5d-323321eee1ca', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f307f-93ff-4283-ba4f-cf1d33c95344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9f307f-93ff-4283-ba4f-cf1d33c95344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ec3369-748d-49d8-a8a1-99d275cf320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume 319086ca-13ee-4920-ba5d-323321eee1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319086ca-13ee-4920-ba5d-323321eee1ca', 'volume_size': 1} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:14 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.522s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-quobyte-9f9d188a-3a71-4a0d-9240-0983a9b2b710-69a041d4-3974-4763-945a-54a27e283158" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-9f9d188a-3a71-4a0d-9240-0983a9b2b710-69a041d4-3974-4763-945a-54a27e283158" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Creating volume 69a041d4-3974-4763-945a-54a27e283158 from snapshot 9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-quobyte-69a041d4-3974-4763-945a-54a27e283158" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-d8d43c3e-1be1-4bc0-94bd-c977b59d3934-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-69a041d4-3974-4763-945a-54a27e283158" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] snapshot: 9f9d188a-3a71-4a0d-9240-0983a9b2b710, volume: 69a041d4-3974-4763-945a-54a27e283158, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Attempting download of a67cec57-1a73-466a-96cb-eb266e755f62 ((None, [{'url': 'file:///opt/stack/data/glance/images/a67cec57-1a73-466a-96cb-eb266e755f62', 'metadata': {}}])) to volume 77735ef3-f45b-4190-a9bd-567e45d7ff46. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-d8d43c3e-1be1-4bc0-94bd-c977b59d3934-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (25dd9469-33f0-49ec-8cd7-e625f3f3d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42d4efb-bd01-43f1-b7f2-b166e972f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c113e5-70bf-4b38-9421-45f2746bec93]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f419cc16-3fbc-4662-99b8-6e81d7c1f49b]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a67cec57-1a73-466a-96cb-eb266e755f62_f956o6xd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42d4efb-bd01-43f1-b7f2-b166e972f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1780601114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e971d1f-2195-4d66-a4b7-440ae5370942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:14Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7afdc02-cda9-4150-8297-88f4f88c573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7afdc02-cda9-4150-8297-88f4f88c573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff1b25a-7298-439b-821f-81c7fadda902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff1b25a-7298-439b-821f-81c7fadda902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e971d1f-2195-4d66-a4b7-440ae5370942', 'volume_name': 'volume-5e971d1f-2195-4d66-a4b7-440ae5370942', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b16beec-66eb-4ebc-b0dd-841d84312183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b16beec-66eb-4ebc-b0dd-841d84312183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899102a6-91d6-4b56-b435-f4ba9d6b8060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:14 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume 5e971d1f-2195-4d66-a4b7-440ae5370942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e971d1f-2195-4d66-a4b7-440ae5370942', 'volume_size': 1} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-quobyte-d8d43c3e-1be1-4bc0-94bd-c977b59d3934" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-d8d43c3e-1be1-4bc0-94bd-c977b59d3934" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:14 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a67cec57-1a73-466a-96cb-eb266e755f62_f956o6xd Nov 05 22:33:14 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:14 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 Nov 05 22:33:14 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8881f34-5e4f-406d-938f-80a1f43ab97f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:14 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 Nov 05 22:33:14 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (69885ec6-778a-43b8-89d2-2affbab57a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55715ad4-a04f-4fac-a26b-40df3b6e3540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:15 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a67cec57-1a73-466a-96cb-eb266e755f62_f956o6xd" returned: 0 in 0.463s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a67cec57-1a73-466a-96cb-eb266e755f62_f956o6xd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:15 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55715ad4-a04f-4fac-a26b-40df3b6e3540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541425991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c01649-9c45-42c4-817f-b21a67dc2bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:15Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0e4de8-737b-49f4-96a3-9f5c383f2526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0e4de8-737b-49f4-96a3-9f5c383f2526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023767dd-347b-4937-a224-d468752a2bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023767dd-347b-4937-a224-d468752a2bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c01649-9c45-42c4-817f-b21a67dc2bfb', 'volume_name': 'volume-24c01649-9c45-42c4-817f-b21a67dc2bfb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9048b0b5-2b35-409e-aae7-1e4ed09ef9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9048b0b5-2b35-409e-aae7-1e4ed09ef9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1581475-467d-43a4-9665-c047b8383ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:15 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume 24c01649-9c45-42c4-817f-b21a67dc2bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c01649-9c45-42c4-817f-b21a67dc2bfb', 'volume_size': 1} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710" returned: 0 in 0.536s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0860a2-bd2f-4848-9b21-cc012692cced]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:15 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a67cec57-1a73-466a-96cb-eb266e755f62_f956o6xd Nov 05 22:33:15 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:15 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:15 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:15 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:15 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934 Nov 05 22:33:15 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:15 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a67cec57-1a73-466a-96cb-eb266e755f62_f956o6xd" returned: 1 in 0.351s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a67cec57-1a73-466a-96cb-eb266e755f62_f956o6xd' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ce438b-c1a3-45ab-9bcc-2434e5089f4f]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:15 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:15 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d8d43c3e-1be1-4bc0-94bd-c977b59d3934" returned: 0 in 0.261s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" returned: 0 in 0.392s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:33:15 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD Nov 05 22:33:15 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-d8d43c3e-1be1-4bc0-94bd-c977b59d3934" released by "delete_volume" :: held 0.808s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:15 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 Nov 05 22:33:15 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created reservations ['ad23a355-7484-4c32-978d-f231f4085195', '8ba81708-a72c-429b-9ede-c47258c0cd06', 'ac12f404-0f6d-4c29-bea9-afa0f0fe486b', '94ecee58-baff-42b5-a64b-edcb5cd8d0c1'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:15 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:15 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:15 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:15 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD Nov 05 22:33:15 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:16 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.290s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Deleted volume successfully. Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c1d869b5-d998-43a3-9a64-33057baba730 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-d8d43c3e-1be1-4bc0-94bd-c977b59d3934-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:16 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] a67cec57-1a73-466a-96cb-eb266e755f62 was raw, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:16 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 Nov 05 22:33:16 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-287aa411-f0b2-4e11-a321-de59b7efb58c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-287aa411-f0b2-4e11-a321-de59b7efb58c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-quobyte-287aa411-f0b2-4e11-a321-de59b7efb58c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-287aa411-f0b2-4e11-a321-de59b7efb58c" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1592986e-6ae7-4ab6-8476-cb63a81a80a8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:17 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c Nov 05 22:33:17 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:17 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46" returned: 0 in 1.093s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a67cec57-1a73-466a-96cb-eb266e755f62_6oigvkgjdevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:33:17 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:17 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 1G Nov 05 22:33:17 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:17 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c" returned: 0 in 0.672s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:17 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c Nov 05 22:33:17 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:17 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 1G" returned: 0 in 0.602s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Downloaded image a67cec57-1a73-466a-96cb-eb266e755f62 ((None, [{'url': 'file:///opt/stack/data/glance/images/a67cec57-1a73-466a-96cb-eb266e755f62', 'metadata': {}}])) to volume 77735ef3-f45b-4190-a9bd-567e45d7ff46 successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Temporary image a67cec57-1a73-466a-96cb-eb266e755f62 for user 0f5406d823124745a1f57b33bd2413c4 is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Marking volume 77735ef3-f45b-4190-a9bd-567e45d7ff46 as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Copying metadata from image a67cec57-1a73-466a-96cb-eb266e755f62 to 77735ef3-f45b-4190-a9bd-567e45d7ff46. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:33:17 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Creating volume glance metadata for volume 77735ef3-f45b-4190-a9bd-567e45d7ff46 backed by image a67cec57-1a73-466a-96cb-eb266e755f62 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a67cec57-1a73-466a-96cb-eb266e755f62', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5c0e1b83d40a1f8598b0116412cd4ca5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:33:18 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-287aa411-f0b2-4e11-a321-de59b7efb58c" returned: 0 in 0.406s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-287aa411-f0b2-4e11-a321-de59b7efb58c" released by "delete_volume" :: held 1.164s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e653a3-8808-4dc7-b836-88f075581ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77735ef3-f45b-4190-a9bd-567e45d7ff46', 'volume_size': 1, 'image_id': 'a67cec57-1a73-466a-96cb-eb266e755f62', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a67cec57-1a73-466a-96cb-eb266e755f62', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5c0e1b83d40a1f8598b0116412cd4ca5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3fa19f82d3db4a18b28a035f66f79cec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a2b02ee4d95dc2380d37dfb762db882b94f61cdc5f785023f70d03d9dda3483995016fd37bd1469ed3366c35b42718ad52c5f0e034f9acb9b9118a444c88191', 'id': 'a67cec57-1a73-466a-96cb-eb266e755f62', 'created_at': datetime.datetime(2026, 11, 5, 21, 33, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 33, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a67cec57-1a73-466a-96cb-eb266e755f62/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c73ad20-3030-4d64-9c1c-a51ee610d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:18 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Volume volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 (77735ef3-f45b-4190-a9bd-567e45d7ff46): created successfully Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c73ad20-3030-4d64-9c1c-a51ee610d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Flow 'volume_create_manager' (0dbcc702-570e-4d16-82b5-c753ebd7ac24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-64c7c7ad-1fad-4cf7-93ce-4710db280222 tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Created volume successfully. Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created reservations ['9e361f4d-4d61-4a70-a4c6-ab77c67b9eb3', '35384222-5a69-45b1-81e5-45246295b9e5', 'e652333c-8f1d-4a7f-9ec4-4961c738676a', '994fca9a-3176-401f-971c-da6594d9b114'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:18 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:18 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:18 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.413s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Deleted volume successfully. Nov 05 22:33:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-2f064ca1-e9da-4301-af89-9a7a1d90e2a6 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-287aa411-f0b2-4e11-a321-de59b7efb58c-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-5d5c06e6-30b4-4828-ad8b-92f59c8f7426-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Acquiring lock "cinder-77735ef3-f45b-4190-a9bd-567e45d7ff46-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-5d5c06e6-30b4-4828-ad8b-92f59c8f7426-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "cinder-77735ef3-f45b-4190-a9bd-567e45d7ff46-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-quobyte-5d5c06e6-30b4-4828-ad8b-92f59c8f7426" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-5d5c06e6-30b4-4828-ad8b-92f59c8f7426" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Acquiring lock "cinder-quobyte-77735ef3-f45b-4190-a9bd-567e45d7ff46" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "cinder-quobyte-77735ef3-f45b-4190-a9bd-567e45d7ff46" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa68d4-6744-481d-97cb-9393f41cade7]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b5e4f-b777-4552-8317-5dce8c19c472]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:19 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 Nov 05 22:33:19 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:19 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 Nov 05 22:33:19 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:20 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46" returned: 0 in 0.685s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:20 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46 Nov 05 22:33:20 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:20 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426" returned: 0 in 0.866s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:20 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426 Nov 05 22:33:20 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:20 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-77735ef3-f45b-4190-a9bd-567e45d7ff46" returned: 0 in 0.503s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "cinder-quobyte-77735ef3-f45b-4190-a9bd-567e45d7ff46" released by "delete_volume" :: held 1.287s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:20 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5d5c06e6-30b4-4828-ad8b-92f59c8f7426" returned: 0 in 0.444s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-5d5c06e6-30b4-4828-ad8b-92f59c8f7426" released by "delete_volume" :: held 1.441s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Created reservations ['8dad5fc5-0236-43fc-a33f-75df1b27c0f4', '4d124152-89ea-4bbd-8191-08121d09509e', '96b0e2e4-d1f6-4365-8ff8-c79697100d88', 'ce2db013-dbc4-48f3-ade1-718778ac9d74'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created reservations ['fb03751b-c345-46b5-8769-10815c165f37', '2c833f8c-bc50-42e2-8162-d6a9200011f9', '2ee0700a-787b-4bd0-ad2f-ee81e4745c16', 'cbb1267b-34fd-4898-832b-51babc6100ca'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:21 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:21 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:21 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:21 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:21 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Deleted volume successfully. Nov 05 22:33:21 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.379s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Deleted volume successfully. Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-161a7496-79c9-4ae1-9728-28e4450ed46d tempest-VolumeAndVolumeTypeFromImageTest-1289306179 None] Lock "cinder-77735ef3-f45b-4190-a9bd-567e45d7ff46-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b2a6a60-69ca-466e-969f-cf2eb7e7b62e tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-5d5c06e6-30b4-4828-ad8b-92f59c8f7426-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-45568e91-6303-4276-9635-bb52f6c7e2d4-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-45568e91-6303-4276-9635-bb52f6c7e2d4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-quobyte-45568e91-6303-4276-9635-bb52f6c7e2d4" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-45568e91-6303-4276-9635-bb52f6c7e2d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e826e1e-7053-496b-9ff2-496e6aab24a1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:22 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 Nov 05 22:33:22 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:22 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4" returned: 0 in 0.714s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:22 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4 Nov 05 22:33:22 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:23 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-45568e91-6303-4276-9635-bb52f6c7e2d4" returned: 0 in 0.453s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-45568e91-6303-4276-9635-bb52f6c7e2d4" released by "delete_volume" :: held 1.266s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created reservations ['445b46c4-fa75-4df5-bb84-f91b6f47ecf9', '88dd8bdc-0999-4542-a8e7-dc5dc2b33ee1', '8162b524-e865-4aca-bed9-30d383ad7561', '38830357-9f53-47c1-8021-206b6a176930'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:23 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:23 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:23 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158" returned: 0 in 7.965s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb, size 1024.00 MB, duration 7.97 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:33:23 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Converted 1024.00 MB image at 128.54 MB/s Nov 05 22:33:23 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 is being set with open permissions: ugo+rw Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:23 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 Nov 05 22:33:23 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:23 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.282s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Deleted volume successfully. Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-749c5824-df20-4a69-8a00-2ca035dc8fca tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-45568e91-6303-4276-9635-bb52f6c7e2d4-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:23 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158" returned: 0 in 0.260s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-69a041d4-3974-4763-945a-54a27e283158" released by "_copy_volume_from_snapshot" :: held 9.309s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-9f9d188a-3a71-4a0d-9240-0983a9b2b710-69a041d4-3974-4763-945a-54a27e283158" released by "_create_volume_from_snapshot" :: held 9.414s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.449s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.472s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1078727342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8ee6c2-b041-4468-8387-a9b736f41ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:13Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Creating volume 2b8ee6c2-b041-4468-8387-a9b736f41ac7 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:23 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:23 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 1073741824 Nov 05 22:33:23 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61db2165-72fc-4bfb-9bed-0558d9a77433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a041d4-3974-4763-945a-54a27e283158', 'volume_size': 1, 'snapshot_id': '9f9d188a-3a71-4a0d-9240-0983a9b2b710'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798baf94-f3f3-4377-9873-c678eca98ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:23 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Volume volume-69a041d4-3974-4763-945a-54a27e283158 (69a041d4-3974-4763-945a-54a27e283158): created successfully Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798baf94-f3f3-4377-9873-c678eca98ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Flow 'volume_create_manager' (87300e6b-8c9d-4cf0-a71b-aab2aa97cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-803a2536-603c-4be0-8894-399e7beef663 tempest-VolumeDependencyTests-996594497 None] Created volume successfully. Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-0d92d584-0b12-4b3c-b794-1b15cb816feb-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-9f9d188a-3a71-4a0d-9240-0983a9b2b710-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-0d92d584-0b12-4b3c-b794-1b15cb816feb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Lock "cinder-9f9d188a-3a71-4a0d-9240-0983a9b2b710-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-quobyte-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-quobyte-9f9d188a-3a71-4a0d-9240-0983a9b2b710" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-quobyte-0d92d584-0b12-4b3c-b794-1b15cb816feb" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-9f9d188a-3a71-4a0d-9240-0983a9b2b710" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Deleting offline snapshot 9f9d188a-3a71-4a0d-9240-0983a9b2b710 of volume 81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] snapshot_file for this snap is: volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-0d92d584-0b12-4b3c-b794-1b15cb816feb" acquired by "delete_volume" :: waited 0.043s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ed35fb-314a-404f-9401-7724584a9e6b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[13715f9b-abee-47ff-b8ec-66d80d4096d8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:24 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 1073741824" returned: 0 in 0.643s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:24 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 Nov 05 22:33:24 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:24 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 Nov 05 22:33:24 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:24 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb Nov 05 22:33:24 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:24 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7" returned: 0 in 0.305s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.137s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507624739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=523fee88-10eb-409b-ba6f-ad7125c5da0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:14Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Creating volume 523fee88-10eb-409b-ba6f-ad7125c5da0f {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:24 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:24 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed575143-45f1-447d-ba9b-98ee671ec75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a0fd96-95af-4162-a09a-f9e8ee95ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:24 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:24 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f 1073741824 Nov 05 22:33:24 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb" returned: 0 in 0.468s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710" returned: 0 in 0.491s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:33:24 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb Nov 05 22:33:24 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:25 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 (2b8ee6c2-b041-4468-8387-a9b736f41ac7): created successfully Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a0fd96-95af-4162-a09a-f9e8ee95ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (07620398-6af3-4eb6-9c2e-9a4309a2d519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1c0e7-86b3-4d3c-b9af-90cc3eb8589a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2333a21c-9e08-4849-8085-70da532c3612 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created volume successfully. Nov 05 22:33:25 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb Nov 05 22:33:25 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:25 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-0d92d584-0b12-4b3c-b794-1b15cb816feb" returned: 0 in 0.396s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-0d92d584-0b12-4b3c-b794-1b15cb816feb" released by "delete_volume" :: held 0.940s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created reservations ['744ec907-556d-41f4-bd2d-df930393f707', '77d30212-6783-46f1-80b0-ee48ac2ae0bb', 'e8ba3b34-879a-4acc-a9a9-2b4460cf787a', 'fe972f84-8991-46f0-a20b-735d3e56d79a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:25 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f 1073741824" returned: 0 in 0.636s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:25 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:25 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:25 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f Nov 05 22:33:25 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:25 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" returned: 0 in 0.753s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:25 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 Nov 05 22:33:25 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:25 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.314s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Deleted volume successfully. Nov 05 22:33:25 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f" returned: 0 in 0.328s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.765s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122484781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319086ca-13ee-4920-ba5d-323321eee1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:14Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Creating volume 319086ca-13ee-4920-ba5d-323321eee1ca {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:25 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3b5941-8ff5-4d84-a945-caf4f2b28954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-523fee88-10eb-409b-ba6f-ad7125c5da0f', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a23380-c043-416b-b620-649220a6eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:26 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca 1073741824 Nov 05 22:33:26 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61d745f2-f4a5-4a47-a9fc-123fd13d3242 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-0d92d584-0b12-4b3c-b794-1b15cb816feb-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:26 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume volume-523fee88-10eb-409b-ba6f-ad7125c5da0f (523fee88-10eb-409b-ba6f-ad7125c5da0f): created successfully Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a23380-c043-416b-b620-649220a6eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (be7ea0d6-a8e1-4026-becc-eb719db69b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c1eb093b-8882-42d2-84be-074cd2555ce1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created volume successfully. Nov 05 22:33:26 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:26 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710 Nov 05 22:33:26 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:26 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca 1073741824" returned: 0 in 0.550s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:26 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb.9f9d188a-3a71-4a0d-9240-0983a9b2b710" returned: 0 in 0.295s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:26 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca Nov 05 22:33:26 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-d38f658b-618a-42ef-8259-96d295184cbc-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-9f9d188a-3a71-4a0d-9240-0983a9b2b710" released by "_delete_snapshot" :: held 2.243s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" released by "delete_snapshot" :: held 2.302s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-d38f658b-618a-42ef-8259-96d295184cbc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "cinder-quobyte-d38f658b-618a-42ef-8259-96d295184cbc" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-d38f658b-618a-42ef-8259-96d295184cbc" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a4718-7e16-4915-99c4-271432fafc8a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Created reservations ['5e478768-56df-437c-a1c0-d84ebc6199c3', '6e5f8c74-4cbd-43e9-a6b9-353e45fa25fe', 'da4b1fa4-4f01-49a3-998f-696340a06851', '88d15c85-c84d-4f63-9cb9-a9eb519d85c0'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:26 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca" returned: 0 in 0.303s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.157s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1780601114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e971d1f-2195-4d66-a4b7-440ae5370942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:14Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Creating volume 5e971d1f-2195-4d66-a4b7-440ae5370942 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:26 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:26 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc Nov 05 22:33:26 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ec3369-748d-49d8-a8a1-99d275cf320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319086ca-13ee-4920-ba5d-323321eee1ca', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:26 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 1073741824 Nov 05 22:33:26 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03ed80e-ad79-44c1-aa78-a6f4607a8d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:26 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Delete snapshot completed successfully. Nov 05 22:33:26 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume volume-319086ca-13ee-4920-ba5d-323321eee1ca (319086ca-13ee-4920-ba5d-323321eee1ca): created successfully Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03ed80e-ad79-44c1-aa78-a6f4607a8d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (b9e3d6bb-7e49-4370-81c7-52a5d840abfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:26 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-40485ee2-399e-48bd-bf79-7c43dfbfa77d tempest-VolumeDependencyTests-996594497 None] Lock "cinder-9f9d188a-3a71-4a0d-9240-0983a9b2b710-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:27 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-dd7767f8-5e92-4a23-9e0c-866b91356964 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created volume successfully. Nov 05 22:33:27 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc" returned: 0 in 0.438s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:27 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc Nov 05 22:33:27 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:27 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 1073741824" returned: 0 in 0.565s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:27 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-d38f658b-618a-42ef-8259-96d295184cbc" returned: 0 in 0.313s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:27 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 Nov 05 22:33:27 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-quobyte-d38f658b-618a-42ef-8259-96d295184cbc" released by "delete_volume" :: held 0.820s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-quobyte-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Created reservations ['3311b348-2493-471a-b58a-db7f145015e0', '0e4bc11c-a60a-42fb-a011-52cd31cc8c28', 'b4cf4fff-3cac-411d-8d3c-23574f709d98', '3a3f6a8a-8c34-41b1-9004-10124a3e2b2c'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c651bac-928c-4f92-8322-3971a74b47ac]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:27 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942" returned: 0 in 0.343s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.715s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541425991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c01649-9c45-42c4-817f-b21a67dc2bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b1e7681c07c4d288c90dbe72c7bc82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:15Z,use_quota=True,user_id='6b2977998c4c4fa9a32ba957556418a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Creating volume 24c01649-9c45-42c4-817f-b21a67dc2bfb {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:27 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:27 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:27 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899102a6-91d6-4b56-b435-f4ba9d6b8060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e971d1f-2195-4d66-a4b7-440ae5370942', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba137e6-0f9b-4a16-b291-a183ee658995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:27 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb 1073741824 Nov 05 22:33:27 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb Nov 05 22:33:27 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume volume-5e971d1f-2195-4d66-a4b7-440ae5370942 (5e971d1f-2195-4d66-a4b7-440ae5370942): created successfully Nov 05 22:33:27 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:27 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba137e6-0f9b-4a16-b291-a183ee658995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:27 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (25dd9469-33f0-49ec-8cd7-e625f3f3d127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:27 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-976025b2-6633-458c-81a4-22549d6be026 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created volume successfully. Nov 05 22:33:28 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:28 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" returned: 0 in 0.613s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.552s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Deleted volume successfully. Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (c4e52f57-c42d-4d88-9625-041832c7ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:28 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb Nov 05 22:33:28 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459ea577-85c1-4241-a438-18d9c96ff4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459ea577-85c1-4241-a438-18d9c96ff4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115703699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741a062-69df-49de-b464-83a878fb7fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:28Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58af1e05-ce67-45db-b1e6-a7910452c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58af1e05-ce67-45db-b1e6-a7910452c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12c4d11-5dfd-404b-b4de-7705c2df4680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12c4d11-5dfd-404b-b4de-7705c2df4680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3741a062-69df-49de-b464-83a878fb7fa9', 'volume_name': 'volume-3741a062-69df-49de-b464-83a878fb7fa9', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97e711a-af85-4305-8c17-55e35f20d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97e711a-af85-4305-8c17-55e35f20d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a24a8-e7f7-4598-a641-0edca9e70cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:28 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Volume 3741a062-69df-49de-b464-83a878fb7fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3741a062-69df-49de-b464-83a878fb7fa9', 'volume_size': 1} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-38a152e7-999b-4c1b-91f8-9452668439d3 tempest-CreateVolumesFromSourceVolumeTest-1244343863 None] Lock "cinder-d38f658b-618a-42ef-8259-96d295184cbc-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:28 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb 1073741824" returned: 0 in 0.951s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:28 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" returned: 0 in 0.475s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb" released by "delete_volume" :: held 1.206s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:28 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb Nov 05 22:33:28 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:28 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Created reservations ['3d7643ae-8e00-4b20-b3fb-ba1e8d08983a', 'e87f3dad-f9b4-4618-8915-3a86f1339def', '8c641f37-6eae-4d27-b712-09b92b6c1792', 'ebd38c26-9807-4a97-92f4-5c633897419b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (ce91a18a-f14a-4ed3-b1ba-c6b994c6b7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd28757-5925-4c2f-9605-6201ceaea724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd28757-5925-4c2f-9605-6201ceaea724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208896943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111074b3-a9c8-42d5-a954-29e6e92464e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:29Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a98f162-b644-442f-ac63-24f23631ebf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a98f162-b644-442f-ac63-24f23631ebf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446a2eab-f2e5-4e7b-b7cf-76fa10a6d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446a2eab-f2e5-4e7b-b7cf-76fa10a6d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111074b3-a9c8-42d5-a954-29e6e92464e0', 'volume_name': 'volume-111074b3-a9c8-42d5-a954-29e6e92464e0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d583d68-85c9-4b88-9190-796429e3bdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d583d68-85c9-4b88-9190-796429e3bdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec920e49-e953-4acd-9d83-080ab1f1e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Volume 111074b3-a9c8-42d5-a954-29e6e92464e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111074b3-a9c8-42d5-a954-29e6e92464e0', 'volume_size': 1} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:29 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:29 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:29 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115703699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741a062-69df-49de-b464-83a878fb7fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:28Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Creating volume 3741a062-69df-49de-b464-83a878fb7fa9 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:29 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1581475-467d-43a4-9665-c047b8383ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c01649-9c45-42c4-817f-b21a67dc2bfb', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:29 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 1073741824 Nov 05 22:33:29 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a982ec-37d9-415b-ba38-2751b05a22df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Volume volume-24c01649-9c45-42c4-817f-b21a67dc2bfb (24c01649-9c45-42c4-817f-b21a67dc2bfb): created successfully Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a982ec-37d9-415b-ba38-2751b05a22df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Flow 'volume_create_manager' (69885ec6-778a-43b8-89d2-2affbab57a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-42325eba-0f66-466b-b6f3-09ccb553565f tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created volume successfully. Nov 05 22:33:29 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.373s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:29 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Deleted volume successfully. Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-10210515-775c-47bc-8575-b45f73d79182 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-81d7e02d-9e96-44aa-aaed-f20b7fe0f5bb-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (2660c8d3-ae23-4931-bb68-9a7dd7a82607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55051de-3b1d-4a72-93d8-ca36b1f7cedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-24c01649-9c45-42c4-817f-b21a67dc2bfb-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55051de-3b1d-4a72-93d8-ca36b1f7cedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1663457117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddd187e-6921-48aa-8cc1-f8786d4c7e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:30Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd55f87-b368-4d44-b8a5-4219b07e5550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:29 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd55f87-b368-4d44-b8a5-4219b07e5550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c47809-667f-4b3e-bac4-b71ff6d31188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c47809-667f-4b3e-bac4-b71ff6d31188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dddd187e-6921-48aa-8cc1-f8786d4c7e60', 'volume_name': 'volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0da9222-7434-4642-b1b1-375c30915d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0da9222-7434-4642-b1b1-375c30915d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea90cf8d-56b6-40eb-86fd-339dc1f616d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Volume dddd187e-6921-48aa-8cc1-f8786d4c7e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60', 'volume_size': 1} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-24c01649-9c45-42c4-817f-b21a67dc2bfb-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-69a041d4-3974-4763-945a-54a27e283158-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-69a041d4-3974-4763-945a-54a27e283158-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-24c01649-9c45-42c4-817f-b21a67dc2bfb" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-24c01649-9c45-42c4-817f-b21a67dc2bfb" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "cinder-quobyte-69a041d4-3974-4763-945a-54a27e283158" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-69a041d4-3974-4763-945a-54a27e283158" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1846f444-a4d1-4a31-89a2-5d38a5183d1b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f092e29c-a24d-42fd-980d-f6c5504cd246]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:30 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 1073741824" returned: 0 in 0.885s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:30 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb Nov 05 22:33:30 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:30 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 Nov 05 22:33:30 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:30 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 Nov 05 22:33:30 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (8c64f2fc-0688-4954-92fe-c03945adefb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3d1863-f440-4777-bca5-5c0a2471b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3d1863-f440-4777-bca5-5c0a2471b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852828744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c648c907-2fda-48e0-a24f-d09a2ba9be28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:30Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120e0edc-c9c8-4258-b4d5-e3099e5342e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120e0edc-c9c8-4258-b4d5-e3099e5342e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd54e0-6664-423a-9e3d-f1516a548d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fd54e0-6664-423a-9e3d-f1516a548d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c648c907-2fda-48e0-a24f-d09a2ba9be28', 'volume_name': 'volume-c648c907-2fda-48e0-a24f-d09a2ba9be28', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2082cd-9324-445c-b410-418cb284bfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2082cd-9324-445c-b410-418cb284bfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88523079-d861-40dd-ac1d-056d410f4001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Volume c648c907-2fda-48e0-a24f-d09a2ba9be28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c648c907-2fda-48e0-a24f-d09a2ba9be28', 'volume_size': 1} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:30 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:30 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (899968c2-0bbd-42d5-b0da-7fd719716868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2264c81d-4600-4679-a58a-7d934e61ce42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb" returned: 0 in 0.674s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:30 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9" returned: 0 in 0.536s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.667s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208896943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111074b3-a9c8-42d5-a954-29e6e92464e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:29Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Creating volume 111074b3-a9c8-42d5-a954-29e6e92464e0 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:30 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb Nov 05 22:33:30 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:30 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2264c81d-4600-4679-a58a-7d934e61ce42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009233392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:31Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed98a95c-30d3-421e-acb7-bcfef7ed4bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 1073741824 Nov 05 22:33:30 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed98a95c-30d3-421e-acb7-bcfef7ed4bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea44b2d-fe78-43ea-80af-361e9598884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea44b2d-fe78-43ea-80af-361e9598884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b', 'volume_name': 'volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b630829-2609-4196-8050-ed017469f645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b630829-2609-4196-8050-ed017469f645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebf7a95-cefc-4086-8ac5-869f5fcd085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:30 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Volume f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b', 'volume_size': 1} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158" returned: 0 in 0.747s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a24a8-e7f7-4598-a641-0edca9e70cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3741a062-69df-49de-b464-83a878fb7fa9', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40af640c-f671-47e7-a2b5-dd6250e7f9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:31 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158 Nov 05 22:33:31 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:31 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Volume volume-3741a062-69df-49de-b464-83a878fb7fa9 (3741a062-69df-49de-b464-83a878fb7fa9): created successfully Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40af640c-f671-47e7-a2b5-dd6250e7f9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (c4e52f57-c42d-4d88-9625-041832c7ae55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0c4bdbed-4a32-44f6-9d6c-4398c6200e41 tempest-CreateVolumesFromImageTest-1370539519 None] Created volume successfully. Nov 05 22:33:31 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-24c01649-9c45-42c4-817f-b21a67dc2bfb" returned: 0 in 0.420s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-24c01649-9c45-42c4-817f-b21a67dc2bfb" released by "delete_volume" :: held 1.184s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:31 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-69a041d4-3974-4763-945a-54a27e283158" returned: 0 in 0.398s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-quobyte-69a041d4-3974-4763-945a-54a27e283158" released by "delete_volume" :: held 1.224s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created reservations ['748b733b-be92-490f-80ba-d08fa3a28737', 'a7bbcf14-10e2-497f-ac9a-ba2298425752', 'ef2274ae-cd5f-4a7f-9859-9add0eae5da2', '5a9f3172-1d83-49fc-ab98-6f75c7e26a61'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Created reservations ['7d2a92da-dfd9-44cc-a800-f0ce43d71a13', '64b6d202-79b6-46ca-b725-b4e1c39a7e63', 'e16a9b9a-d504-4ba8-ac34-10114c56f26a', 'b942d0c3-cf0b-4b18-9738-ba20ba870c20'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:31 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:31 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:31 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 1073741824" returned: 0 in 0.665s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:31 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:31 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:31 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 Nov 05 22:33:31 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:31 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.349s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Deleted volume successfully. Nov 05 22:33:31 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.301s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Deleted volume successfully. Nov 05 22:33:31 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-6898cb1c-de60-4f4a-a452-c33e77bfcabc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-24c01649-9c45-42c4-817f-b21a67dc2bfb-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0" returned: 0 in 0.304s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1663457117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddd187e-6921-48aa-8cc1-f8786d4c7e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:30Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Creating volume dddd187e-6921-48aa-8cc1-f8786d4c7e60 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:31 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-865557c9-e361-4006-afa2-914456117fd6 tempest-VolumeDependencyTests-996594497 None] Lock "cinder-69a041d4-3974-4763-945a-54a27e283158-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec920e49-e953-4acd-9d83-080ab1f1e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111074b3-a9c8-42d5-a954-29e6e92464e0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:32 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 1073741824 Nov 05 22:33:32 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289c9829-737b-40e1-8be5-295f155034a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Volume volume-111074b3-a9c8-42d5-a954-29e6e92464e0 (111074b3-a9c8-42d5-a954-29e6e92464e0): created successfully Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289c9829-737b-40e1-8be5-295f155034a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (ce91a18a-f14a-4ed3-b1ba-c6b994c6b7ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c96cd2e5-a11d-48a7-939c-30691e65d11d tempest-CreateVolumesFromImageTest-1370539519 None] Created volume successfully. Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-5e971d1f-2195-4d66-a4b7-440ae5370942-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-5e971d1f-2195-4d66-a4b7-440ae5370942-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-5e971d1f-2195-4d66-a4b7-440ae5370942" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-5e971d1f-2195-4d66-a4b7-440ae5370942" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[494dbc7c-dff0-4cac-9f58-79e8e72d1197]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:32 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 1073741824" returned: 0 in 0.573s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:32 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 Nov 05 22:33:32 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:32 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 Nov 05 22:33:32 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:32 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942" returned: 0 in 0.437s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:32 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:32 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942 Nov 05 22:33:32 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.243s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852828744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c648c907-2fda-48e0-a24f-d09a2ba9be28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:30Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Creating volume c648c907-2fda-48e0-a24f-d09a2ba9be28 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:32 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea90cf8d-56b6-40eb-86fd-339dc1f616d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4930156d-8fcf-4e75-ab7b-0a909882b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:32 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 1073741824 Nov 05 22:33:32 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:33 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Volume volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 (dddd187e-6921-48aa-8cc1-f8786d4c7e60): created successfully Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4930156d-8fcf-4e75-ab7b-0a909882b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (2660c8d3-ae23-4931-bb68-9a7dd7a82607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ded66655-ae9d-444f-894d-5022ac3e8eac tempest-CreateVolumesFromImageTest-1370539519 None] Created volume successfully. Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-54466df1-4636-4661-ad07-1de92dbf9523 tempest-ProjectAdminTests-144825938 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.420322418213, 'free_capacity_gb': 1773.420322418213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87085) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 22:33:33 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-5e971d1f-2195-4d66-a4b7-440ae5370942" returned: 0 in 0.376s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-5e971d1f-2195-4d66-a4b7-440ae5370942" released by "delete_volume" :: held 0.871s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created reservations ['15753e25-a28e-4dc1-925f-36a108479d0d', 'fe87b681-8373-4bea-9bd9-d7e1af7920be', 'c41b90bf-a321-442b-877a-4720e63ec4df', 'e3a52358-a966-4467-a9c7-919cf6a386a4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:33 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:33 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-319086ca-13ee-4920-ba5d-323321eee1ca-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-319086ca-13ee-4920-ba5d-323321eee1ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-319086ca-13ee-4920-ba5d-323321eee1ca" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-319086ca-13ee-4920-ba5d-323321eee1ca" acquired by "delete_volume" :: waited 0.017s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:33 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5113e94-6139-4c17-918d-a54eb58e13c5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 1073741824" returned: 0 in 0.843s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:33 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 Nov 05 22:33:33 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:33 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.375s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Deleted volume successfully. Nov 05 22:33:33 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca Nov 05 22:33:33 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:33 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-35c9a494-e35b-49be-891c-a0d24bb726c1 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-5e971d1f-2195-4d66-a4b7-440ae5370942-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:34 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28" returned: 0 in 0.351s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1009233392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40c93025f09c4b30abf95e364f9da7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:31Z,use_quota=True,user_id='b621827b242a490e839b701d7444c631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Creating volume f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:34 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88523079-d861-40dd-ac1d-056d410f4001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c648c907-2fda-48e0-a24f-d09a2ba9be28', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9759399b-5227-4f8c-8f7e-bd513e02cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:34 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b 1073741824 Nov 05 22:33:34 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:34 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Volume volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 (c648c907-2fda-48e0-a24f-d09a2ba9be28): created successfully Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9759399b-5227-4f8c-8f7e-bd513e02cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (8c64f2fc-0688-4954-92fe-c03945adefb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:34 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d49a99e4-911f-4da8-ba45-6f65d63e91d8 tempest-CreateVolumesFromImageTest-1370539519 None] Created volume successfully. Nov 05 22:33:34 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca" returned: 0 in 0.720s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:34 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca Nov 05 22:33:34 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:34 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-319086ca-13ee-4920-ba5d-323321eee1ca" returned: 0 in 0.332s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-319086ca-13ee-4920-ba5d-323321eee1ca" released by "delete_volume" :: held 1.122s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:34 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b 1073741824" returned: 0 in 0.641s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created reservations ['19a35530-8965-46ed-9e95-96db7a990013', '4be46bc1-a521-4d2d-b58d-2f3d9c79977b', '673f848b-4048-4dc2-9a68-61018daeb370', '37e85585-b415-4d6f-adc8-2d9fd7a9be4e'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:34 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b Nov 05 22:33:34 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:35 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:35 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:35 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b" returned: 0 in 0.325s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebf7a95-cefc-4086-8ac5-869f5fcd085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d00f27-4349-4c2a-b47e-7adf75293065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Volume volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b (f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b): created successfully Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d00f27-4349-4c2a-b47e-7adf75293065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Flow 'volume_create_manager' (899968c2-0bbd-42d5-b0da-7fd719716868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:35 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.329s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Deleted volume successfully. Nov 05 22:33:35 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a63980ff-a648-42e9-9d04-6e953e7504b2 tempest-CreateVolumesFromImageTest-1370539519 None] Created volume successfully. Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bc00d12c-ac9e-4a45-8e6f-aa0cbcb89beb tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-319086ca-13ee-4920-ba5d-323321eee1ca-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-quobyte-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2771a467-a0aa-4ee3-8858-93aeab49db35]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-523fee88-10eb-409b-ba6f-ad7125c5da0f-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:35 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b Nov 05 22:33:35 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-523fee88-10eb-409b-ba6f-ad7125c5da0f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-523fee88-10eb-409b-ba6f-ad7125c5da0f" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-523fee88-10eb-409b-ba6f-ad7125c5da0f" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdd0647-f23a-4926-996e-8781d1154f40]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:36 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f Nov 05 22:33:36 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:36 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b" returned: 0 in 0.498s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:36 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b Nov 05 22:33:36 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:36 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f" returned: 0 in 0.486s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:36 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f Nov 05 22:33:36 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:36 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b" released by "delete_volume" :: held 0.856s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Created reservations ['00ae75e7-3769-4e56-ba25-dd92bd117d8f', '9d672eb2-feca-435a-9f17-107273554a72', '9c879141-23de-4a70-81c1-5395fff262be', '6c652235-ee3b-4b3c-9fbc-926b5b3af137'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:36 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:36 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:36 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-523fee88-10eb-409b-ba6f-ad7125c5da0f" returned: 0 in 0.325s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-c648c907-2fda-48e0-a24f-d09a2ba9be28-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-523fee88-10eb-409b-ba6f-ad7125c5da0f" released by "delete_volume" :: held 0.892s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-c648c907-2fda-48e0-a24f-d09a2ba9be28-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-quobyte-c648c907-2fda-48e0-a24f-d09a2ba9be28" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created reservations ['3775fbb7-971e-4ec4-b29d-cd1ff3f734cd', '8b107388-fea4-46ad-be26-08f833ec5984', '6cc07278-1153-4f4a-bae1-c970d95bf186', '39b92bff-1bdc-48e6-a93e-45a7ca40097a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-c648c907-2fda-48e0-a24f-d09a2ba9be28" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[12db881f-dc1a-48e9-815e-76869860ccef]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:37 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.406s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Deleted volume successfully. Nov 05 22:33:37 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:37 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4281b89f-8087-4047-bd4c-c3fabd615ec6 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-f1af9343-2eb3-4e0b-9cfb-e78150fe2c2b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:37 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 Nov 05 22:33:37 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:37 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.347s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Deleted volume successfully. Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d41aebf7-497f-4d48-9dc9-a32a72ecd2cc tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-523fee88-10eb-409b-ba6f-ad7125c5da0f-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:37 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28" returned: 0 in 0.521s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:37 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28 Nov 05 22:33:37 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:37 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c648c907-2fda-48e0-a24f-d09a2ba9be28" returned: 0 in 0.323s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-c648c907-2fda-48e0-a24f-d09a2ba9be28" released by "delete_volume" :: held 0.931s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Created reservations ['fc038970-bace-4566-8e57-1f2d13998741', 'a3f10461-6822-4e62-87bc-79fafea862ee', 'bd2975d3-fdf9-45a0-8f08-2f79d00e1e84', 'c3f13d47-aa0c-428f-93ae-9b53b1a9ced0'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:38 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:38 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-dddd187e-6921-48aa-8cc1-f8786d4c7e60-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-dddd187e-6921-48aa-8cc1-f8786d4c7e60-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-quobyte-dddd187e-6921-48aa-8cc1-f8786d4c7e60" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-2b8ee6c2-b041-4468-8387-a9b736f41ac7-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-dddd187e-6921-48aa-8cc1-f8786d4c7e60" acquired by "delete_volume" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-2b8ee6c2-b041-4468-8387-a9b736f41ac7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd16e6-5f41-426b-8246-68efbcda05fd]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:38 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-2b8ee6c2-b041-4468-8387-a9b736f41ac7" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.404s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Deleted volume successfully. Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-2b8ee6c2-b041-4468-8387-a9b736f41ac7" acquired by "delete_volume" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9fb9d35-9fe1-4c94-89ac-62a622a16eb1 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-c648c907-2fda-48e0-a24f-d09a2ba9be28-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d286f-7946-4934-b6ae-0abbb25808af]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:38 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 Nov 05 22:33:38 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:38 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 Nov 05 22:33:38 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:38 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60" returned: 0 in 0.524s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:39 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60 Nov 05 22:33:39 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:39 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7" returned: 0 in 0.472s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:39 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7 Nov 05 22:33:39 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:39 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-dddd187e-6921-48aa-8cc1-f8786d4c7e60" returned: 0 in 0.289s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-dddd187e-6921-48aa-8cc1-f8786d4c7e60" released by "delete_volume" :: held 0.891s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Created reservations ['aff1987d-7525-4134-b37d-73c59366627d', '175c84cd-956d-4401-bf85-3425764571c3', 'fd0059a2-0554-44b7-acb0-c875a98c0300', '476202c2-c111-4119-bc3f-fc9533939a0e'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:39 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2b8ee6c2-b041-4468-8387-a9b736f41ac7" returned: 0 in 0.300s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-2b8ee6c2-b041-4468-8387-a9b736f41ac7" released by "delete_volume" :: held 0.873s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:39 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:39 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created reservations ['11052516-6d6f-45a2-a2f8-96fae8fc6cd9', 'd5e6f1c6-e1b2-484b-851f-642534aa987d', '05bc97e9-4566-4d08-957d-2bec69a378e8', 'a9e84747-e194-483d-8579-3b5ee6e0ed85'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-111074b3-a9c8-42d5-a954-29e6e92464e0-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-111074b3-a9c8-42d5-a954-29e6e92464e0-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:39 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:39 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-quobyte-111074b3-a9c8-42d5-a954-29e6e92464e0" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-111074b3-a9c8-42d5-a954-29e6e92464e0" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-c472c19d-f589-492a-8cb1-d02d2d098a34-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:39 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce7e8ff-9a47-4fd5-9fb0-74788e3d7488]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-c472c19d-f589-492a-8cb1-d02d2d098a34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.439s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Deleted volume successfully. Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-c472c19d-f589-492a-8cb1-d02d2d098a34" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-935e673b-b31d-48c9-82f2-5753d46a0f62 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-dddd187e-6921-48aa-8cc1-f8786d4c7e60-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-c472c19d-f589-492a-8cb1-d02d2d098a34" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Deleting offline snapshot c472c19d-f589-492a-8cb1-d02d2d098a34 of volume fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] snapshot_file for this snap is: volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:40 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 Nov 05 22:33:40 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Flow 'volume_create_manager' (744c4f6f-89fc-4492-8253-bf3ba5c669f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceec8d45-48c6-412c-a63a-feb016e36e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e00b5-a894-4e91-a338-a5442b69703f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:40 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.436s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Deleted volume successfully. Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceec8d45-48c6-412c-a63a-feb016e36e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca42fb94bc445f969f3b6c6d1fb4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:40Z,use_quota=True,user_id='caea4812d3714dc7a06d6ed9ed656e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f16cbf-ce79-49d3-bb5b-fd8725e9dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f16cbf-ce79-49d3-bb5b-fd8725e9dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1c57ba-b5b1-4bd1-8f3e-ed59b3a1c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.image.glance [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Creating Keystone auth plugin from conf {{(pid=87085) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-33d75a29-0443-4a7f-8d2a-cb7d27221d6c tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-2b8ee6c2-b041-4468-8387-a9b736f41ac7-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:40 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 Nov 05 22:33:40 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:40 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:40 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:40 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0" returned: 0 in 0.627s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:40 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0 Nov 05 22:33:40 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1c57ba-b5b1-4bd1-8f3e-ed59b3a1c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d', 'volume_name': 'volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d', 'volume_size': 1, 'image_id': '072738eb-c3f5-4c11-b630-173e1b018df7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072738eb-c3f5-4c11-b630-173e1b018df7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3982c471101e7d287a5f88a099de79f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbca42fb94bc445f969f3b6c6d1fb4ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d0316cebca9af896ac87e06d156de1b7b62edd35c02eb891ca0572e7954dfa2c249c5682c2f3ffdc3c3b3ae9cd0940d4039f0602115a67da324e291ff58c0bc', 'id': '072738eb-c3f5-4c11-b630-173e1b018df7', 'created_at': datetime.datetime(2026, 11, 5, 21, 33, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 33, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072738eb-c3f5-4c11-b630-173e1b018df7/file', 'properties': {}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc58bd8-47f2-4fa6-a69e-f0b20985ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc58bd8-47f2-4fa6-a69e-f0b20985ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e70664-8997-4c4a-8f2e-42b8cbd35cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:40 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Volume 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d', 'volume_size': 1, 'image_id': '072738eb-c3f5-4c11-b630-173e1b018df7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072738eb-c3f5-4c11-b630-173e1b018df7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3982c471101e7d287a5f88a099de79f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbca42fb94bc445f969f3b6c6d1fb4ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d0316cebca9af896ac87e06d156de1b7b62edd35c02eb891ca0572e7954dfa2c249c5682c2f3ffdc3c3b3ae9cd0940d4039f0602115a67da324e291ff58c0bc', 'id': '072738eb-c3f5-4c11-b630-173e1b018df7', 'created_at': datetime.datetime(2026, 11, 5, 21, 33, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 33, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072738eb-c3f5-4c11-b630-173e1b018df7/file', 'properties': {}}, 'image_service': } Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Trying to clone 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d from image 072738eb-c3f5-4c11-b630-173e1b018df7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/072738eb-c3f5-4c11-b630-173e1b018df7', 'metadata': {}}]). {{(pid=87085) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 22:33:40 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34" returned: 0 in 0.563s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:33:40 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[735c0c06-73c3-4637-bb2b-b764af68c17b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 22:33:40 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Image download 0.00 MB at 0.00 MB/s Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b1b5f-12ef-416e-a2a4-47aef5b8e201]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:40 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 Nov 05 22:33:40 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:40 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-111074b3-a9c8-42d5-a954-29e6e92464e0" returned: 0 in 0.392s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-111074b3-a9c8-42d5-a954-29e6e92464e0" released by "delete_volume" :: held 1.120s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:40 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD Nov 05 22:33:40 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:40 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Created reservations ['1676138d-4de3-4a68-ba50-fcd17c5e8b56', '0240be3d-62a6-403b-95be-a7de5b857ee3', '540a6f9d-11b9-484d-ab67-ea31d2c4b820', 'b5d6b5c5-ecbe-4a81-b809-549c1e653c63'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:41 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:41 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:41 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:41 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" returned: 0 in 0.577s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:41 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 Nov 05 22:33:41 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:41 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Deleted volume successfully. Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8086e2b7-c829-4778-a58c-122af1030e66 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-111074b3-a9c8-42d5-a954-29e6e92464e0-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:41 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD Nov 05 22:33:41 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:41 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34" returned: 0 in 0.420s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:41 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Temporary image 072738eb-c3f5-4c11-b630-173e1b018df7 is fetched for user caea4812d3714dc7a06d6ed9ed656e7d. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 22:33:41 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34 Nov 05 22:33:41 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce2c370-878a-43cd-9de3-ab4498be8ea8]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:41 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD Nov 05 22:33:41 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-3741a062-69df-49de-b464-83a878fb7fa9-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-3741a062-69df-49de-b464-83a878fb7fa9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:41 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8.c472c19d-f589-492a-8cb1-d02d2d098a34" returned: 0 in 0.313s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-c472c19d-f589-492a-8cb1-d02d2d098a34" released by "_delete_snapshot" :: held 2.075s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" released by "delete_snapshot" :: held 2.152s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "cinder-quobyte-3741a062-69df-49de-b464-83a878fb7fa9" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-3741a062-69df-49de-b464-83a878fb7fa9" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7fafc0-3cb0-425e-a6fe-405ee0ec2a24]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created reservations ['671260c7-21b6-424b-a7b7-46402f19e382', '1c0983c8-bcf8-46f7-bb07-cbfe1224afbd', '55aa5457-9345-4f7e-a71e-812f97a78fcd', '3f4897b0-90da-475e-8c10-449b1870a9fe'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:42 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Delete snapshot completed successfully. Nov 05 22:33:42 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8b9d7cf1-edc3-4971-94e9-70dd03e62cbe tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-c472c19d-f589-492a-8cb1-d02d2d098a34-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:42 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:42 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD Nov 05 22:33:42 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:42 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9" returned: 0 in 0.376s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:42 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:42 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9 Nov 05 22:33:42 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbca42fb94bc445f969f3b6c6d1fb4ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:40Z,use_quota=True,user_id='caea4812d3714dc7a06d6ed9ed656e7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Creating volume 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:42 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:42 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d 1073741824 Nov 05 22:33:42 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:42 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3741a062-69df-49de-b464-83a878fb7fa9" returned: 0 in 0.269s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-quobyte-3741a062-69df-49de-b464-83a878fb7fa9" released by "delete_volume" :: held 0.698s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Created reservations ['dff08509-b115-47ec-8528-ccd70f2381b4', 'bfe9c0d5-ed6a-428c-ab4e-35769f128b3d', '5ff183ae-f4ec-44f5-bc52-2f08f39b78f8', 'e28fbff6-6c52-4aa2-9563-df737bc116e4'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:42 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:42 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:43 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d 1073741824" returned: 0 in 0.539s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "cinder-quobyte-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:43 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d Nov 05 22:33:43 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3575d4-db54-4f0c-9f0c-6fef8a034094]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:43 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.418s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:43 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Deleted volume successfully. Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f20de395-4254-4f47-9567-0dcbb1ce1490 tempest-CreateVolumesFromImageTest-1370539519 None] Lock "cinder-3741a062-69df-49de-b464-83a878fb7fa9-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:43 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 Nov 05 22:33:43 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:43 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d" returned: 0 in 0.368s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Attempting download of 072738eb-c3f5-4c11-b630-173e1b018df7 ((None, [{'url': 'file:///opt/stack/data/glance/images/072738eb-c3f5-4c11-b630-173e1b018df7', 'metadata': {}}])) to volume 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f60c4e2-96e9-4fc8-8414-2f907b9f38a9]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072738eb-c3f5-4c11-b630-173e1b018df7_pef5pj9f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:43 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:43 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072738eb-c3f5-4c11-b630-173e1b018df7_pef5pj9f Nov 05 22:33:43 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" returned: 0 in 0.478s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:43 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8 Nov 05 22:33:43 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:44 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072738eb-c3f5-4c11-b630-173e1b018df7_pef5pj9f" returned: 0 in 0.382s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072738eb-c3f5-4c11-b630-173e1b018df7_pef5pj9f {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:44 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" returned: 0 in 0.311s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-quobyte-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8" released by "delete_volume" :: held 0.902s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:44 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072738eb-c3f5-4c11-b630-173e1b018df7_pef5pj9f Nov 05 22:33:44 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Created reservations ['a1b3a042-e9e3-41b2-8c97-77fcdb3a74a0', '1eb025ce-47c3-43bc-85bd-78d7ade0164d', '7e356acc-42e2-4691-82df-035497c6a65e', 'ed3394c5-b8c7-4654-93ef-feae3c765127'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:44 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:44 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:44 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072738eb-c3f5-4c11-b630-173e1b018df7_pef5pj9f" returned: 1 in 0.471s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072738eb-c3f5-4c11-b630-173e1b018df7_pef5pj9f' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a409dc01-2445-4e68-83f3-acdec35c78e9]: (4, 'raw') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:44 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD Nov 05 22:33:44 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:44 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.316s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:44 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Deleted volume successfully. Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae11ca6e-4b92-4543-8c9a-2756d726f8c0 tempest-CreateVolumesFromSnapshotTest-1061893941 None] Lock "cinder-fbf91279-b7db-40cb-9fc3-d4d9d2ef26d8-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:44 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:45 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD Nov 05 22:33:45 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:45 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 22:33:45 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] 072738eb-c3f5-4c11-b630-173e1b018df7 was raw, converting to qcow2 {{(pid=87085) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 22:33:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:45 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d Nov 05 22:33:45 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:45 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d" returned: 0 in 0.567s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:45 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_072738eb-c3f5-4c11-b630-173e1b018df7_skmqcb4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:33:45 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 22:33:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:45 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d 1G Nov 05 22:33:45 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:46 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d 1G" returned: 0 in 0.400s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Downloaded image 072738eb-c3f5-4c11-b630-173e1b018df7 ((None, [{'url': 'file:///opt/stack/data/glance/images/072738eb-c3f5-4c11-b630-173e1b018df7', 'metadata': {}}])) to volume 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d successfully. {{(pid=87085) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Temporary image 072738eb-c3f5-4c11-b630-173e1b018df7 for user caea4812d3714dc7a06d6ed9ed656e7d is deleted. {{(pid=87085) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.volume_utils [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Marking volume 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d as bootable. {{(pid=87085) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Copying metadata from image 072738eb-c3f5-4c11-b630-173e1b018df7 to 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d. {{(pid=87085) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Creating volume glance metadata for volume 8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d backed by image 072738eb-c3f5-4c11-b630-173e1b018df7 with: {'image_id': '072738eb-c3f5-4c11-b630-173e1b018df7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3982c471101e7d287a5f88a099de79f1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87085) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e70664-8997-4c4a-8f2e-42b8cbd35cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d', 'volume_size': 1, 'image_id': '072738eb-c3f5-4c11-b630-173e1b018df7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072738eb-c3f5-4c11-b630-173e1b018df7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3982c471101e7d287a5f88a099de79f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fbca42fb94bc445f969f3b6c6d1fb4ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d0316cebca9af896ac87e06d156de1b7b62edd35c02eb891ca0572e7954dfa2c249c5682c2f3ffdc3c3b3ae9cd0940d4039f0602115a67da324e291ff58c0bc', 'id': '072738eb-c3f5-4c11-b630-173e1b018df7', 'created_at': datetime.datetime(2026, 11, 5, 21, 33, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 21, 33, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072738eb-c3f5-4c11-b630-173e1b018df7/file', 'properties': {}}, 'image_service': }' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6eb97f2-d7d4-4332-b5ee-10e38a7acf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:46 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Volume volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d (8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d): created successfully Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6eb97f2-d7d4-4332-b5ee-10e38a7acf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:46 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Flow 'volume_create_manager' (744c4f6f-89fc-4492-8253-bf3ba5c669f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:46 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7441d830-b7fe-42c4-b273-95cae7578c6a tempest-VolumeImageDependencyTests-1694871922 None] Created volume successfully. Nov 05 22:33:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Acquiring lock "cinder-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Lock "cinder-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Acquiring lock "cinder-quobyte-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Lock "cinder-quobyte-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:47 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e96bf14-c13d-419b-8faf-94dc187f7169]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:48 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d Nov 05 22:33:48 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:48 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d" returned: 0 in 0.521s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:48 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d Nov 05 22:33:48 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:48 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d" returned: 0 in 0.318s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Lock "cinder-quobyte-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d" released by "delete_volume" :: held 0.911s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Created reservations ['d5eb2d65-57aa-432f-8df7-a02bc94858a1', 'a770816c-bd10-4203-93d0-30c51a9792b7', '61445da7-d3dd-4fae-b8fe-89abf61758ca', '7c10c559-9b82-430c-93a8-0b49e22ed01e'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (63229319-b633-4467-baf1-86f402d9bce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb209594-caf7-4c55-bef9-f7fd0dd86954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb209594-caf7-4c55-bef9-f7fd0dd86954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651828769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb76477-0bb1-458b-b452-3bf69e9a5b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:49Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f687806a-a434-4d01-b09a-155304b5693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f687806a-a434-4d01-b09a-155304b5693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a38da9c-dbe7-479b-86c4-342621dba07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a38da9c-dbe7-479b-86c4-342621dba07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eb76477-0bb1-458b-b452-3bf69e9a5b52', 'volume_name': 'volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0ce485-d90e-45d2-bb0b-2999720c02e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0ce485-d90e-45d2-bb0b-2999720c02e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aa468b-bc6e-4366-99da-a22c052219ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Volume 4eb76477-0bb1-458b-b452-3bf69e9a5b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52', 'volume_size': 1} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-651828769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eb76477-0bb1-458b-b452-3bf69e9a5b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:49Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Creating volume 4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:49 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:49 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 1073741824 Nov 05 22:33:49 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:49 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:49 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:49 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.411s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:49 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Deleted volume successfully. Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-649143a1-6c6f-45d2-8d50-7345e7e90a6e tempest-VolumeImageDependencyTests-1694871922 None] Lock "cinder-8ce69ab3-8ff3-43d0-a784-3cf2a3a8709d-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Flow 'volume_create_manager' (29f72714-2264-4115-8859-23c640dd9edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed8672e-a6bf-4f86-a076-5df0066b9e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed8672e-a6bf-4f86-a076-5df0066b9e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf58977-e788-4619-b900-b09f65b5d257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b8a5797d1943beba53e4f83b2bfe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:50Z,use_quota=True,user_id='f3aedd770be74d69851e47d5495b6b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ff3cea-b56a-4944-959b-d9381f758a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ff3cea-b56a-4944-959b-d9381f758a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3426028-282c-46f6-8740-06232547cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3426028-282c-46f6-8740-06232547cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf58977-e788-4619-b900-b09f65b5d257', 'volume_name': 'volume-cbf58977-e788-4619-b900-b09f65b5d257', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4425414e-17c0-4cba-bbe2-7881a75b891f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4425414e-17c0-4cba-bbe2-7881a75b891f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0084b0eb-67b3-4f30-b070-8aa9f2461d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:49 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Volume cbf58977-e788-4619-b900-b09f65b5d257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf58977-e788-4619-b900-b09f65b5d257', 'volume_size': 1} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:49 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 1073741824" returned: 0 in 0.744s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:49 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:49 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 Nov 05 22:33:49 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:50 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52" returned: 0 in 0.265s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf58977-e788-4619-b900-b09f65b5d257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b8a5797d1943beba53e4f83b2bfe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:50Z,use_quota=True,user_id='f3aedd770be74d69851e47d5495b6b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Creating volume cbf58977-e788-4619-b900-b09f65b5d257 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:50 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aa468b-bc6e-4366-99da-a22c052219ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:50 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 1073741824 Nov 05 22:33:50 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121cbcb3-bae3-4106-b278-ca27d6a5258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:50 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Volume volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 (4eb76477-0bb1-458b-b452-3bf69e9a5b52): created successfully Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121cbcb3-bae3-4106-b278-ca27d6a5258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (63229319-b633-4467-baf1-86f402d9bce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:50 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-51a94638-cbc9-42c7-b384-27526032bc15 tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:33:50 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 1073741824" returned: 0 in 0.587s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:50 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:50 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 Nov 05 22:33:50 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:51 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257" returned: 0 in 0.330s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0084b0eb-67b3-4f30-b070-8aa9f2461d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf58977-e788-4619-b900-b09f65b5d257', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda0c7fb-414e-4803-8698-6cd8b3e2095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Volume volume-cbf58977-e788-4619-b900-b09f65b5d257 (cbf58977-e788-4619-b900-b09f65b5d257): created successfully Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda0c7fb-414e-4803-8698-6cd8b3e2095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Flow 'volume_create_manager' (29f72714-2264-4115-8859-23c640dd9edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3ca69cfd-2b1e-4cd3-a041-101decff949e tempest-CinderUnicodeTest-616378086 None] Created volume successfully. Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Creating offline snapshot 1253f827-17ad-41ee-b652-0aaefea83c14 of volume 4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1993f1-7d4b-490f-9474-3a7d38eec4ac]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:51 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 Nov 05 22:33:51 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:52 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52" returned: 0 in 0.458s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:52 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 1G Nov 05 22:33:52 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Flow 'volume_create_manager' (61052074-de95-4d57-8f84-1b8f4cf2c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2dcf2c-c2f9-49a5-b6e5-4279be56e2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2dcf2c-c2f9-49a5-b6e5-4279be56e2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-684423673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b865774a-8702-4353-b8e3-5901aabba780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b8a5797d1943beba53e4f83b2bfe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:52Z,use_quota=True,user_id='f3aedd770be74d69851e47d5495b6b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329a1312-df36-4a6b-a631-88588c2e32c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329a1312-df36-4a6b-a631-88588c2e32c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb05cea-5d89-41d8-9019-7d62943e05bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb05cea-5d89-41d8-9019-7d62943e05bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b865774a-8702-4353-b8e3-5901aabba780', 'volume_name': 'volume-b865774a-8702-4353-b8e3-5901aabba780', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93bddcc-88d0-46db-8aba-dd42f8df458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93bddcc-88d0-46db-8aba-dd42f8df458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eadcb8-5866-4a03-959c-13d1def371e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:52 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Volume b865774a-8702-4353-b8e3-5901aabba780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b865774a-8702-4353-b8e3-5901aabba780', 'volume_size': 1} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:52 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 1G" returned: 0 in 0.524s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:52 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 Nov 05 22:33:52 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:52 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14" returned: 0 in 0.345s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:52 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 is being set with open permissions: ugo+rw Nov 05 22:33:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:53 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 Nov 05 22:33:53 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:53 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14" returned: 0 in 0.300s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:53 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.info Nov 05 22:33:53 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:53 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.info" returned: 0 in 0.329s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:53 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.info is being set with open permissions: ugo+rw Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:53 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.info Nov 05 22:33:53 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:53 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.info" returned: 0 in 0.270s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-684423673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b865774a-8702-4353-b8e3-5901aabba780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b8a5797d1943beba53e4f83b2bfe0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:33:52Z,use_quota=True,user_id='f3aedd770be74d69851e47d5495b6b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Creating volume b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:33:53 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:33:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:54 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 1073741824 Nov 05 22:33:54 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a3859cfe-fe69-420c-bf5a-9227746a70d0 tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:33:54 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 1073741824" returned: 0 in 0.549s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:54 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 Nov 05 22:33:54 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-1253f827-17ad-41ee-b652-0aaefea83c14-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Lock "cinder-1253f827-17ad-41ee-b652-0aaefea83c14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-4eb76477-0bb1-458b-b452-3bf69e9a5b52" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-4eb76477-0bb1-458b-b452-3bf69e9a5b52" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-1253f827-17ad-41ee-b652-0aaefea83c14" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:54 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780" returned: 0 in 0.297s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-1253f827-17ad-41ee-b652-0aaefea83c14" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot 1253f827-17ad-41ee-b652-0aaefea83c14 of volume 4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67eadcb8-5866-4a03-959c-13d1def371e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b865774a-8702-4353-b8e3-5901aabba780', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4769f1ff-339e-42c2-a8df-538402c5064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e224b8ae-5597-48ad-b18b-08df3d47f8a5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Volume volume-b865774a-8702-4353-b8e3-5901aabba780 (b865774a-8702-4353-b8e3-5901aabba780): created successfully Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4769f1ff-339e-42c2-a8df-538402c5064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Flow 'volume_create_manager' (61052074-de95-4d57-8f84-1b8f4cf2c822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:33:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1d36dec7-76cb-4af4-b3f3-3b1c85c7f336 tempest-CinderUnicodeTest-616378086 None] Created volume successfully. Nov 05 22:33:55 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 Nov 05 22:33:55 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:55 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14" returned: 0 in 0.478s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a79a97-da28-4105-a991-127dfb1ffdb8]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:55 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 Nov 05 22:33:55 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Creating offline snapshot c5501cfd-1a57-4cbb-985d-13cfdbde06a7 of volume b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d048268a-5556-4597-b57b-49588c1cbcea]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:55 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52" returned: 0 in 0.472s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:55 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 Nov 05 22:33:55 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:56 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 Nov 05 22:33:56 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:56 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780" returned: 0 in 0.476s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:56 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 1G Nov 05 22:33:56 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:56 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14" returned: 0 in 0.533s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:56 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14 Nov 05 22:33:56 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:56 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52.1253f827-17ad-41ee-b652-0aaefea83c14" returned: 0 in 0.332s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-1253f827-17ad-41ee-b652-0aaefea83c14" released by "_delete_snapshot" :: held 2.006s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-4eb76477-0bb1-458b-b452-3bf69e9a5b52" released by "delete_snapshot" :: held 2.045s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:56 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 1G" returned: 0 in 0.599s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b865774a-8702-4353-b8e3-5901aabba780 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:56 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Created reservations ['8fc18067-94a0-4502-abe4-0e21fee0344a', 'cbf2bad6-b734-45d5-8408-dc9025520665', 'b32a6310-adf9-42f5-b678-8c2a2df98411', '3a0ef02e-3368-4979-b38b-1b3f1e3af553'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:57 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b865774a-8702-4353-b8e3-5901aabba780 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 Nov 05 22:33:57 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:33:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-b53f1026-d8e6-492d-b027-bfe202a1daaf tempest-ProjectMemberTests-533561658 None] Lock "cinder-1253f827-17ad-41ee-b652-0aaefea83c14-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:57 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b865774a-8702-4353-b8e3-5901aabba780 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7" returned: 0 in 0.394s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:57 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 is being set with open permissions: ugo+rw Nov 05 22:33:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:57 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 Nov 05 22:33:57 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:57 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7" returned: 0 in 0.294s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:57 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.info Nov 05 22:33:57 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-4eb76477-0bb1-458b-b452-3bf69e9a5b52-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Lock "cinder-4eb76477-0bb1-458b-b452-3bf69e9a5b52-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:58 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.info" returned: 0 in 0.379s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:58 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.info is being set with open permissions: ugo+rw Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-4eb76477-0bb1-458b-b452-3bf69e9a5b52" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:58 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.info Nov 05 22:33:58 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-4eb76477-0bb1-458b-b452-3bf69e9a5b52" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b292f-7d1a-4bc6-812d-3eeb0de9fcba]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:58 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 Nov 05 22:33:58 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:58 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.info" returned: 0 in 0.330s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8e5c47fd-50c8-499f-a179-b5b3137e4c74 tempest-CinderUnicodeTest-616378086 None] Create snapshot completed successfully Nov 05 22:33:58 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52" returned: 0 in 0.436s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:58 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52 Nov 05 22:33:58 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:58 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-4eb76477-0bb1-458b-b452-3bf69e9a5b52" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-4eb76477-0bb1-458b-b452-3bf69e9a5b52" released by "delete_volume" :: held 0.826s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Acquiring lock "cinder-c5501cfd-1a57-4cbb-985d-13cfdbde06a7-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Created reservations ['dd148e93-a1e8-46ae-abfc-0c0d1c4ce570', '0b66b302-7e29-4186-88e4-79d4bbc42e60', 'aeff2321-bbaa-4327-8372-d3c995380560', '0c572b4b-8162-4e5e-bf88-2ad6a7f13b6a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Lock "cinder-c5501cfd-1a57-4cbb-985d-13cfdbde06a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Acquiring lock "cinder-quobyte-b865774a-8702-4353-b8e3-5901aabba780" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-b865774a-8702-4353-b8e3-5901aabba780" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Acquiring lock "cinder-quobyte-c5501cfd-1a57-4cbb-985d-13cfdbde06a7" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-c5501cfd-1a57-4cbb-985d-13cfdbde06a7" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Deleting offline snapshot c5501cfd-1a57-4cbb-985d-13cfdbde06a7 of volume b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] snapshot_file for this snap is: volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17b4c5c-472a-4488-b30b-f0dab43a26b9]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:33:59 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:33:59 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:59 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 Nov 05 22:33:59 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:33:59 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.373s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:33:59 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f708f3d1-a194-4ab2-9c91-946b02c74c6c tempest-ProjectMemberTests-533561658 None] Lock "cinder-4eb76477-0bb1-458b-b452-3bf69e9a5b52-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:33:59 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7" returned: 0 in 0.575s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b865774a-8702-4353-b8e3-5901aabba780(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e937efd6-e36a-4ce9-979c-2f178bb249e6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:33:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:00 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 Nov 05 22:34:00 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (a116aea2-28c0-4fde-966c-a3e39fda22fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1328d30f-9b91-4a71-8029-688223f3636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1328d30f-9b91-4a71-8029-688223f3636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442681829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396489b6-8fed-43c1-928c-9cd969dc7276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:00Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09015e6-095a-4333-8922-6376106afce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09015e6-095a-4333-8922-6376106afce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79b5a17-6225-4e10-be82-4ed372403483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79b5a17-6225-4e10-be82-4ed372403483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396489b6-8fed-43c1-928c-9cd969dc7276', 'volume_name': 'volume-396489b6-8fed-43c1-928c-9cd969dc7276', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8945de79-a709-4175-a16e-c5b2d6d526db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8945de79-a709-4175-a16e-c5b2d6d526db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e46c66-857f-4227-b8d4-9de620e548c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Volume 396489b6-8fed-43c1-928c-9cd969dc7276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396489b6-8fed-43c1-928c-9cd969dc7276', 'volume_size': 1} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-442681829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396489b6-8fed-43c1-928c-9cd969dc7276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:00Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Creating volume 396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:00 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:00 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 1073741824 Nov 05 22:34:00 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (4377a991-e23e-4a5e-a568-4c1fdc48eca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5000bb-8df3-4ed8-9e93-aec1a0c09d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5000bb-8df3-4ed8-9e93-aec1a0c09d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439853918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36360c11-91b3-4903-8359-7f074c07c84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:00Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9ad4d8-6249-4eac-b523-1a6b76df7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9ad4d8-6249-4eac-b523-1a6b76df7abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad4c809-a62d-4be2-8ad1-bbe0ba07b50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad4c809-a62d-4be2-8ad1-bbe0ba07b50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36360c11-91b3-4903-8359-7f074c07c84c', 'volume_name': 'volume-36360c11-91b3-4903-8359-7f074c07c84c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76d68fb-9693-43a0-ac09-ed01b0b07263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c76d68fb-9693-43a0-ac09-ed01b0b07263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93c96d8-5ccc-4820-b044-347c6902f09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:00 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Volume 36360c11-91b3-4903-8359-7f074c07c84c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36360c11-91b3-4903-8359-7f074c07c84c', 'volume_size': 1} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:00 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780" returned: 0 in 0.566s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:00 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 Nov 05 22:34:00 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:00 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 1073741824" returned: 0 in 0.541s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:00 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7" returned: 0 in 0.397s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:00 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 Nov 05 22:34:00 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:00 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7 Nov 05 22:34:00 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:01 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1439853918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36360c11-91b3-4903-8359-7f074c07c84c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:00Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Creating volume 36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:01 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:01 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c 1073741824 Nov 05 22:34:01 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780.c5501cfd-1a57-4cbb-985d-13cfdbde06a7" returned: 0 in 0.323s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e46c66-857f-4227-b8d4-9de620e548c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396489b6-8fed-43c1-928c-9cd969dc7276', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591eac1a-3c6b-45f0-8ccb-b03d4109e220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Volume volume-396489b6-8fed-43c1-928c-9cd969dc7276 (396489b6-8fed-43c1-928c-9cd969dc7276): created successfully Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591eac1a-3c6b-45f0-8ccb-b03d4109e220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (a116aea2-28c0-4fde-966c-a3e39fda22fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (63247d78-5696-4459-9971-9984e8d8f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439921ab-d844-4d13-8b67-6f27e69f6265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-c5501cfd-1a57-4cbb-985d-13cfdbde06a7" released by "_delete_snapshot" :: held 2.118s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-83ab84be-83a5-4b9e-8a90-23a94307123d tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-b865774a-8702-4353-b8e3-5901aabba780" released by "delete_snapshot" :: held 2.170s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439921ab-d844-4d13-8b67-6f27e69f6265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145699156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad209cdc-60f5-45d4-83ab-8be03fed8ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:01Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1bc89e-c4f0-4869-a564-34e422814c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1bc89e-c4f0-4869-a564-34e422814c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f999377f-244f-4894-9ac4-837369f6f1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f999377f-244f-4894-9ac4-837369f6f1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad209cdc-60f5-45d4-83ab-8be03fed8ae0', 'volume_name': 'volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7150c225-88e5-4cc6-abb8-d74f3f040d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7150c225-88e5-4cc6-abb8-d74f3f040d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5506bab-df81-4821-b0ca-6c9737afacaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Volume ad209cdc-60f5-45d4-83ab-8be03fed8ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0', 'volume_size': 1} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Created reservations ['72097ee6-d4ba-47e6-a28d-e253f15e4fea', 'd31c1368-6b1c-47fa-a33d-43f96466da48', 'd1ed733d-0bad-4196-b50c-bf92cbc84df6', 'e15f95fd-8d0a-403b-8f2a-e39532e78495'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Delete snapshot completed successfully. Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3544d049-2f43-4595-9fcb-565bf0eabefa tempest-CinderUnicodeTest-616378086 None] Lock "cinder-c5501cfd-1a57-4cbb-985d-13cfdbde06a7-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:01 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c 1073741824" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:01 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c Nov 05 22:34:01 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:01 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c" returned: 0 in 0.251s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145699156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad209cdc-60f5-45d4-83ab-8be03fed8ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:01Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Creating volume ad209cdc-60f5-45d4-83ab-8be03fed8ae0 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=213,cinder:UPDATE=273,cinder:INSERT=77,cinder:DELETE=32 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93c96d8-5ccc-4820-b044-347c6902f09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36360c11-91b3-4903-8359-7f074c07c84c', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 1073741824 Nov 05 22:34:01 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6a778b-86a7-4b84-b63a-68df7ceace62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Volume volume-36360c11-91b3-4903-8359-7f074c07c84c (36360c11-91b3-4903-8359-7f074c07c84c): created successfully Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6a778b-86a7-4b84-b63a-68df7ceace62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (4377a991-e23e-4a5e-a568-4c1fdc48eca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:01 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=299,cinder:SELECT=212,cinder:INSERT=76,cinder:DELETE=19 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:34:01 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-31379187-24b1-4b32-a123-6a06578e4051 tempest-ProjectReaderTests-2127386985 None] Created volume successfully. Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Acquiring lock "cinder-b865774a-8702-4353-b8e3-5901aabba780-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Lock "cinder-b865774a-8702-4353-b8e3-5901aabba780-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:02 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Acquiring lock "cinder-quobyte-b865774a-8702-4353-b8e3-5901aabba780" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 1073741824" returned: 0 in 0.517s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-b865774a-8702-4353-b8e3-5901aabba780" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7460409-3aeb-463f-a4f9-b40c895b564c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:02 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 Nov 05 22:34:02 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:02 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 Nov 05 22:34:02 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:02 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0" returned: 0 in 0.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.465s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5506bab-df81-4821-b0ca-6c9737afacaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e85d2f-6fd4-4df2-a009-9c2b6d4ae7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Creating offline snapshot 943af7e8-bf99-4d85-800c-b415f70f3032 of volume 396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:02 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Volume volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 (ad209cdc-60f5-45d4-83ab-8be03fed8ae0): created successfully Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e85d2f-6fd4-4df2-a009-9c2b6d4ae7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (63247d78-5696-4459-9971-9984e8d8f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[9792f1f9-2d98-498a-8e26-62a60a961985]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ff6fbb22-31bb-4625-9366-ae5db0c70744 tempest-ProjectReaderTests-901413739 None] Created volume successfully. Nov 05 22:34:02 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780" returned: 0 in 0.389s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:02 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 Nov 05 22:34:02 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:02 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780 Nov 05 22:34:02 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-b865774a-8702-4353-b8e3-5901aabba780" returned: 0 in 0.259s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-b865774a-8702-4353-b8e3-5901aabba780" released by "delete_volume" :: held 0.751s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:03 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276" returned: 0 in 0.395s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 1G Nov 05 22:34:03 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Created reservations ['f2bce324-8ceb-470e-b78b-09b36ef1ebcb', 'd3354544-3e3a-41fd-85b5-00d523126aa0', 'a092ec9f-2c3a-4445-9eaa-9f56184c484c', '701bb5f4-f085-4c8e-bc84-e253c7d2e2bb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:03 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-ad209cdc-60f5-45d4-83ab-8be03fed8ae0-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Lock "cinder-ad209cdc-60f5-45d4-83ab-8be03fed8ae0-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-quobyte-ad209cdc-60f5-45d4-83ab-8be03fed8ae0" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Acquiring lock "cinder-cbf58977-e788-4619-b900-b09f65b5d257-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Lock "cinder-cbf58977-e788-4619-b900-b09f65b5d257-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-ad209cdc-60f5-45d4-83ab-8be03fed8ae0" acquired by "delete_volume" :: waited 0.042s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ae42c-0dc6-4d74-8df4-f8d083e0a170]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Acquiring lock "cinder-quobyte-cbf58977-e788-4619-b900-b09f65b5d257" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-cbf58977-e788-4619-b900-b09f65b5d257" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e82c8-55b1-4151-ad61-97426ed02bb1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.389s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:03 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:03 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Deleted volume successfully. Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 1G" returned: 0 in 0.573s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-396489b6-8fed-43c1-928c-9cd969dc7276 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:03 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 Nov 05 22:34:03 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-396489b6-8fed-43c1-928c-9cd969dc7276 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 Nov 05 22:34:03 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-ae18377f-d9a0-42a1-96e2-c0b3470c70ae tempest-CinderUnicodeTest-616378086 None] Lock "cinder-b865774a-8702-4353-b8e3-5901aabba780-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:03 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 Nov 05 22:34:03 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:03 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0" returned: 0 in 0.434s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0 Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-396489b6-8fed-43c1-928c-9cd969dc7276 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 is being set with open permissions: ugo+rw Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 Nov 05 22:34:04 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257" returned: 0 in 0.411s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257 Nov 05 22:34:04 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad209cdc-60f5-45d4-83ab-8be03fed8ae0" returned: 0 in 0.263s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-ad209cdc-60f5-45d4-83ab-8be03fed8ae0" released by "delete_volume" :: held 0.751s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:04 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032" returned: 0 in 0.286s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-cbf58977-e788-4619-b900-b09f65b5d257" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Created reservations ['cec2bb31-738c-458b-b068-c68389d80670', '91f7191c-7240-484d-9fc6-bf3a955d3bb2', 'c66ef040-e592-4af9-8555-5309bafcf4eb', 'f030c523-4203-4734-ab4a-bd73b5c37ee9'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Lock "cinder-quobyte-cbf58977-e788-4619-b900-b09f65b5d257" released by "delete_volume" :: held 0.764s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:04 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.info Nov 05 22:34:04 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Created reservations ['470d4a94-d336-4824-bddd-29e8979fdc13', 'cc8849f6-09de-4903-a96d-83f282bd8d6c', '50d9bb4d-99f7-4661-8d3c-6abfad34c0d0', '699bd361-ad7a-4a51-aaa5-d3b8cc670f0f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:04 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:04 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:04 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.info" returned: 0 in 0.362s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.info is being set with open permissions: ugo+rw Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:04 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.info Nov 05 22:34:04 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:04 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Deleted volume successfully. Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-0a109a06-9165-450b-900b-41875c7502dd tempest-ProjectReaderTests-901413739 None] Lock "cinder-ad209cdc-60f5-45d4-83ab-8be03fed8ae0-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:04 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.367s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Deleted volume successfully. Nov 05 22:34:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-7c4ae488-3585-4356-bfa6-63e74ee89926 tempest-CinderUnicodeTest-616378086 None] Lock "cinder-cbf58977-e788-4619-b900-b09f65b5d257-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:05 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.info" returned: 0 in 0.336s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.608s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:05 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-6a6635a8-7fc1-4c4d-9d22-7e504e834ffa tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Creating offline snapshot 74c94ac8-d226-46f8-b5b9-d030d532ae00 of volume 36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8acfec-184f-4376-8592-7e3591f4db21]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (b1a715a1-511d-40d7-adb3-10d256d01e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e35c9c5-7592-4178-943b-d24670c09bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e35c9c5-7592-4178-943b-d24670c09bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450882301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26baed2f-7a26-4fbe-a54e-dae9e7f63123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:05Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be67f05f-f78c-408b-99ca-d55750c783b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be67f05f-f78c-408b-99ca-d55750c783b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:05 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c Nov 05 22:34:05 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5691af-f121-4c7e-abd8-42781836cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5691af-f121-4c7e-abd8-42781836cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26baed2f-7a26-4fbe-a54e-dae9e7f63123', 'volume_name': 'volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dffe17-3e57-4bbe-aa96-971560a30ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dffe17-3e57-4bbe-aa96-971560a30ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6882e1bf-242b-4a00-ae19-53de0741ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:05 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Volume 26baed2f-7a26-4fbe-a54e-dae9e7f63123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123', 'volume_size': 1} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-943af7e8-bf99-4d85-800c-b415f70f3032-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Lock "cinder-943af7e8-bf99-4d85-800c-b415f70f3032-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-396489b6-8fed-43c1-928c-9cd969dc7276" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-396489b6-8fed-43c1-928c-9cd969dc7276" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-943af7e8-bf99-4d85-800c-b415f70f3032" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-943af7e8-bf99-4d85-800c-b415f70f3032" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot 943af7e8-bf99-4d85-800c-b415f70f3032 of volume 396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f27514-2c1d-4ea2-a690-840e4ad99903]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:05 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 Nov 05 22:34:05 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:05 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c" returned: 0 in 0.515s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:05 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 1G Nov 05 22:34:05 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:05 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032" returned: 0 in 0.427s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-396489b6-8fed-43c1-928c-9cd969dc7276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[290fcef2-a29c-4e61-99f6-adb4c8177389]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:06 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 Nov 05 22:34:06 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:06 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 1G" returned: 0 in 0.506s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36360c11-91b3-4903-8359-7f074c07c84c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:06 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36360c11-91b3-4903-8359-7f074c07c84c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 Nov 05 22:34:06 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:06 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:06 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 Nov 05 22:34:06 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:06 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36360c11-91b3-4903-8359-7f074c07c84c -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:06 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 is being set with open permissions: ugo+rw Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:06 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 Nov 05 22:34:06 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:06 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032" returned: 0 in 0.388s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:06 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032 Nov 05 22:34:06 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:06 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00" returned: 0 in 0.303s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:06 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.info Nov 05 22:34:06 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:07 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276.943af7e8-bf99-4d85-800c-b415f70f3032" returned: 0 in 0.277s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-943af7e8-bf99-4d85-800c-b415f70f3032" released by "_delete_snapshot" :: held 1.711s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:07 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-396489b6-8fed-43c1-928c-9cd969dc7276" released by "delete_snapshot" :: held 1.737s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.info" returned: 0 in 0.289s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:07 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.info is being set with open permissions: ugo+rw Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:07 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.info Nov 05 22:34:07 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Created reservations ['253ae071-754a-4988-9533-b57538712da4', '4ec1ed06-39b6-4b7d-b286-39174c8ce650', 'da24fbd6-c3b9-4fd2-ae82-0ce136704a1c', '3a87deff-916f-49f9-9227-cf7e24709627'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-41315d96-544e-4877-b52b-ef5d78473ccb tempest-ProjectMemberTests-533561658 None] Lock "cinder-943af7e8-bf99-4d85-800c-b415f70f3032-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:07 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.info" returned: 0 in 0.265s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.109s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450882301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26baed2f-7a26-4fbe-a54e-dae9e7f63123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:05Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Creating volume 26baed2f-7a26-4fbe-a54e-dae9e7f63123 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:07 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:07 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 1073741824 Nov 05 22:34:07 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:07 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-30a907e4-c6a5-41dd-906b-a6c32f2d1a34 tempest-ProjectReaderTests-2127386985 None] Create snapshot completed successfully Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-396489b6-8fed-43c1-928c-9cd969dc7276-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Lock "cinder-396489b6-8fed-43c1-928c-9cd969dc7276-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-396489b6-8fed-43c1-928c-9cd969dc7276" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-396489b6-8fed-43c1-928c-9cd969dc7276" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1792dda7-c770-4b47-99e7-ec78eb8553aa]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:07 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 Nov 05 22:34:07 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:08 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-74c94ac8-d226-46f8-b5b9-d030d532ae00-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 1073741824" returned: 0 in 0.575s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-74c94ac8-d226-46f8-b5b9-d030d532ae00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-36360c11-91b3-4903-8359-7f074c07c84c" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-36360c11-91b3-4903-8359-7f074c07c84c" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-74c94ac8-d226-46f8-b5b9-d030d532ae00" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:08 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 Nov 05 22:34:08 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-74c94ac8-d226-46f8-b5b9-d030d532ae00" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Deleting offline snapshot 74c94ac8-d226-46f8-b5b9-d030d532ae00 of volume 36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] snapshot_file for this snap is: volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[181ac8c7-0cf4-4fd8-9e3d-3f61a49fcf88]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:08 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276" returned: 0 in 0.509s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:08 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276 Nov 05 22:34:08 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:08 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 Nov 05 22:34:08 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:08 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123" returned: 0 in 0.341s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6882e1bf-242b-4a00-ae19-53de0741ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d4024-bc83-46b0-b880-643825d03a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:08 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Volume volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 (26baed2f-7a26-4fbe-a54e-dae9e7f63123): created successfully Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620d4024-bc83-46b0-b880-643825d03a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (b1a715a1-511d-40d7-adb3-10d256d01e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cf2c8122-0671-409c-bec4-ce67ad5ca1a8 tempest-ProjectReaderTests-901413739 None] Created volume successfully. Nov 05 22:34:08 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-396489b6-8fed-43c1-928c-9cd969dc7276" returned: 0 in 0.310s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-396489b6-8fed-43c1-928c-9cd969dc7276" released by "delete_volume" :: held 0.887s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:08 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00" returned: 0 in 0.483s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36360c11-91b3-4903-8359-7f074c07c84c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Created reservations ['acb65bbd-6801-41d7-891c-6a42a36e1f2f', '89d395e1-568a-4095-a9f1-dc64ab8eca6c', '972a19d6-8c86-4c59-991e-79da5e02be6a', 'd3b97c21-4e3e-4355-b7c2-69868152d56d'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a25f77-cfb1-49fa-bb52-1a838cb0db73]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:08 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:08 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:08 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c Nov 05 22:34:08 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:09 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.267s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:09 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5eaef983-484a-4e6b-948c-3a88c918aeb6 tempest-ProjectMemberTests-533561658 None] Lock "cinder-396489b6-8fed-43c1-928c-9cd969dc7276-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:09 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c" returned: 0 in 0.440s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:09 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 Nov 05 22:34:09 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-26baed2f-7a26-4fbe-a54e-dae9e7f63123-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Lock "cinder-26baed2f-7a26-4fbe-a54e-dae9e7f63123-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-quobyte-26baed2f-7a26-4fbe-a54e-dae9e7f63123" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-26baed2f-7a26-4fbe-a54e-dae9e7f63123" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:09 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00" returned: 0 in 0.431s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b985e-a894-4386-b7de-4d76c199a472]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:09 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00 Nov 05 22:34:09 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:09 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 Nov 05 22:34:09 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:09 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c.74c94ac8-d226-46f8-b5b9-d030d532ae00" returned: 0 in 0.291s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-74c94ac8-d226-46f8-b5b9-d030d532ae00" released by "_delete_snapshot" :: held 1.811s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:09 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-36360c11-91b3-4903-8359-7f074c07c84c" released by "delete_snapshot" :: held 1.853s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:10 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Created reservations ['5ce3e729-d60d-49c6-bbed-ccc5ff068bfd', '05416ad2-b280-41dc-9e51-936be94a8d7c', '24ce06d7-bfe5-4b11-92b9-e87c506451d7', '76501bf5-6043-4db8-a39f-f7c9a0b4f737'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123" returned: 0 in 0.415s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:10 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123 Nov 05 22:34:10 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:10 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Delete snapshot completed successfully. Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a0767e70-44d5-478e-a0a8-86fa55965669 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-74c94ac8-d226-46f8-b5b9-d030d532ae00-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-36360c11-91b3-4903-8359-7f074c07c84c-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Lock "cinder-36360c11-91b3-4903-8359-7f074c07c84c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-36360c11-91b3-4903-8359-7f074c07c84c" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-36360c11-91b3-4903-8359-7f074c07c84c" acquired by "delete_volume" :: waited 0.047s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:10 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-26baed2f-7a26-4fbe-a54e-dae9e7f63123" returned: 0 in 0.423s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bf7d9a-1c34-4342-ad6e-fff246f4ba73]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-26baed2f-7a26-4fbe-a54e-dae9e7f63123" released by "delete_volume" :: held 0.916s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (b1e729ed-a9ba-4388-8cd2-b81aaab9e058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f29b466-0712-41b5-9fc9-988c352b8ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:10 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c Nov 05 22:34:10 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f29b466-0712-41b5-9fc9-988c352b8ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867897169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22747411-5ded-4edb-86c2-353bdbd3a1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:11Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50517d48-c7c4-415d-9ac6-50a4cd6c65f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50517d48-c7c4-415d-9ac6-50a4cd6c65f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70f7278-b6bb-4b34-9c87-2f1050a55b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70f7278-b6bb-4b34-9c87-2f1050a55b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22747411-5ded-4edb-86c2-353bdbd3a1c0', 'volume_name': 'volume-22747411-5ded-4edb-86c2-353bdbd3a1c0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8e92e8-c9a9-4d26-8bde-b281099d103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8e92e8-c9a9-4d26-8bde-b281099d103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb236a8-41a8-40b7-b4ea-cfa08e41656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:10 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Volume 22747411-5ded-4edb-86c2-353bdbd3a1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22747411-5ded-4edb-86c2-353bdbd3a1c0', 'volume_size': 1} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867897169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22747411-5ded-4edb-86c2-353bdbd3a1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:11Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Creating volume 22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:10 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:10 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 1073741824 Nov 05 22:34:10 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Created reservations ['bbd806b3-3c61-43ae-9b75-81ab219149aa', 'd4648976-3f3f-4e25-885b-602e6166a1f2', '10d9df6b-90f4-4ea2-8a69-9eb2b62ca255', '5786733c-8086-4447-9096-5d193fc214f6'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:10 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:10 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:11 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c" returned: 0 in 0.506s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:11 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c Nov 05 22:34:11 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:11 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Deleted volume successfully. Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-bfe55793-6d20-405e-8b83-4cde6f2d6568 tempest-ProjectReaderTests-901413739 None] Lock "cinder-26baed2f-7a26-4fbe-a54e-dae9e7f63123-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:11 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 1073741824" returned: 0 in 0.599s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:11 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-36360c11-91b3-4903-8359-7f074c07c84c" returned: 0 in 0.347s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-36360c11-91b3-4903-8359-7f074c07c84c" released by "delete_volume" :: held 0.976s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:11 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 Nov 05 22:34:11 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Created reservations ['68901151-83c5-4720-a08e-5c3f6e96ac0a', 'a9121554-de45-4ac4-b899-0904430f26c2', '64732005-6386-40f1-a682-b9e3f19e9d32', '84a55e38-2768-44f4-9893-b9f9a782d59f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:11 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:11 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:11 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0" returned: 0 in 0.309s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb236a8-41a8-40b7-b4ea-cfa08e41656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22747411-5ded-4edb-86c2-353bdbd3a1c0', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c3dbd8-36a9-4a89-a9e3-874b0b61372f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:11 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Volume volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 (22747411-5ded-4edb-86c2-353bdbd3a1c0): created successfully Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c3dbd8-36a9-4a89-a9e3-874b0b61372f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (b1e729ed-a9ba-4388-8cd2-b81aaab9e058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1d9aa482-fa03-4666-9210-c917569a8e0a tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:34:11 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.294s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Deleted volume successfully. Nov 05 22:34:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-fa8e1500-4f98-4e42-9cdf-fe92f51c8b0b tempest-ProjectReaderTests-2127386985 None] Lock "cinder-36360c11-91b3-4903-8359-7f074c07c84c-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (2930d5c7-7ef4-4a9a-a9aa-a68aa6269e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d973858-6a3b-403f-ad4e-c8c92bdfd41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d973858-6a3b-403f-ad4e-c8c92bdfd41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738770021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883e7cfb-d7ef-4bfe-b79c-51e9c73d0911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:12Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098159dd-a1f8-4b87-b05c-92f2047efe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098159dd-a1f8-4b87-b05c-92f2047efe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d90e181-d38d-4a2e-bcfc-81e1c73c0e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d90e181-d38d-4a2e-bcfc-81e1c73c0e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883e7cfb-d7ef-4bfe-b79c-51e9c73d0911', 'volume_name': 'volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c73c05-1f30-456d-baeb-2f575b0437aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c73c05-1f30-456d-baeb-2f575b0437aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ba5402-0717-4c3f-a478-e2b25116a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:12 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Volume 883e7cfb-d7ef-4bfe-b79c-51e9c73d0911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911', 'volume_size': 1} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738770021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883e7cfb-d7ef-4bfe-b79c-51e9c73d0911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:12Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Creating volume 883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:12 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:12 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 1073741824 Nov 05 22:34:12 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:12 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 1073741824" returned: 0 in 0.576s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:13 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 Nov 05 22:34:13 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (bb94da82-5e7f-4e0e-a2a7-9298c18a670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf71f2c-4343-435d-a3b7-001d09bd7f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf71f2c-4343-435d-a3b7-001d09bd7f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104506431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382ae2a0-17bd-4d80-b65d-d15dbfc839e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:13Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61cc67e-e961-486c-a97a-2b48cb6bb6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61cc67e-e961-486c-a97a-2b48cb6bb6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b8c4ca-8836-432e-aee6-054421beb931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b8c4ca-8836-432e-aee6-054421beb931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '382ae2a0-17bd-4d80-b65d-d15dbfc839e4', 'volume_name': 'volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b567388-91c7-43cb-9509-ca526ffac76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b567388-91c7-43cb-9509-ca526ffac76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f74463-0a4e-4e88-a0b2-4d5b82109d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Volume 382ae2a0-17bd-4d80-b65d-d15dbfc839e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4', 'volume_size': 1} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:13 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911" returned: 0 in 0.332s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.156s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ba5402-0717-4c3f-a478-e2b25116a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402c1d76-e089-4508-93f7-b1474f1b0696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Creating offline snapshot 02f92091-3d15-4dba-baa2-4eb611026ab2 of volume 22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:13 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Volume volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 (883e7cfb-d7ef-4bfe-b79c-51e9c73d0911): created successfully Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402c1d76-e089-4508-93f7-b1474f1b0696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (2930d5c7-7ef4-4a9a-a9aa-a68aa6269e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[898441b5-4a66-4515-b0ff-b248481a7d09]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e052aced-0f35-4b38-8691-5994d6b71b9a tempest-ProjectReaderTests-901413739 None] Created volume successfully. Nov 05 22:34:13 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 Nov 05 22:34:13 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:13 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0" returned: 0 in 0.387s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:13 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 1G Nov 05 22:34:13 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:14 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 1G" returned: 0 in 0.454s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:14 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 Nov 05 22:34:14 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Lock "cinder-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-quobyte-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c700ad2a-b3f7-4c42-8d94-d1de5e6bd0f7]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:14 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2" returned: 0 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:14 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 is being set with open permissions: ugo+rw Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:14 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 Nov 05 22:34:14 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:14 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 Nov 05 22:34:14 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:14 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2" returned: 0 in 0.279s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:14 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.info Nov 05 22:34:14 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:15 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911" returned: 0 in 0.419s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:15 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911 Nov 05 22:34:15 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:15 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.info" returned: 0 in 0.321s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:15 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.info is being set with open permissions: ugo+rw Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:15 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.info Nov 05 22:34:15 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:15 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911" returned: 0 in 0.312s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911" released by "delete_volume" :: held 0.789s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Created reservations ['38e197ad-36dd-426d-b331-d2a1ff73953b', '3e348171-8375-4ea1-aa60-8f6185c0bfcb', '8f750170-7f5a-4fec-8d0a-a80ead065005', '6faeb86f-c74b-428a-83a0-5c5bdfddbb4e'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:15 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.info" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:15 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:15 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.265s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104506431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=382ae2a0-17bd-4d80-b65d-d15dbfc839e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:13Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Creating volume 382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:15 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-cafdabb6-5aa6-41b3-9319-dae97a60dd74 tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:34:15 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 1073741824 Nov 05 22:34:15 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:15 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:15 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Deleted volume successfully. Nov 05 22:34:15 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-09ed5bae-9e3a-4cfd-a4d4-cc297b7aa3c4 tempest-ProjectReaderTests-901413739 None] Lock "cinder-883e7cfb-d7ef-4bfe-b79c-51e9c73d0911-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-02f92091-3d15-4dba-baa2-4eb611026ab2-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:16 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 1073741824" returned: 0 in 0.650s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-02f92091-3d15-4dba-baa2-4eb611026ab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-22747411-5ded-4edb-86c2-353bdbd3a1c0" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-22747411-5ded-4edb-86c2-353bdbd3a1c0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-02f92091-3d15-4dba-baa2-4eb611026ab2" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:16 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-02f92091-3d15-4dba-baa2-4eb611026ab2" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:16 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot 02f92091-3d15-4dba-baa2-4eb611026ab2 of volume 22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (3c1ba942-4c73-4e68-9cc4-f2ce5ba3f120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b941e97-2d35-496d-a8f8-42495d5fc9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8944f6e7-05e7-4144-a202-9f2c5d5ed5c2]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b941e97-2d35-496d-a8f8-42495d5fc9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783857650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b410a-c420-40a8-ba55-f52088351ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:16Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90385a77-8f6a-47e9-967a-56f1c2d7867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90385a77-8f6a-47e9-967a-56f1c2d7867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c115af76-4ec2-457d-87f8-cf3613fbf2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c115af76-4ec2-457d-87f8-cf3613fbf2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0b410a-c420-40a8-ba55-f52088351ec1', 'volume_name': 'volume-6b0b410a-c420-40a8-ba55-f52088351ec1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f35fe6f-fc9f-45c7-a0d9-8139fc59dd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f35fe6f-fc9f-45c7-a0d9-8139fc59dd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b739479-d4ea-4087-85d2-eb5fa57fd4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:16 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Volume 6b0b410a-c420-40a8-ba55-f52088351ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0b410a-c420-40a8-ba55-f52088351ec1', 'volume_size': 1} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:16 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 Nov 05 22:34:16 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:16 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" returned: 0 in 0.285s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783857650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b410a-c420-40a8-ba55-f52088351ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55883c96d0043498975c805c185dcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:16Z,use_quota=True,user_id='e3f386a7a8fd462aaf009e605bedc934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Creating volume 6b0b410a-c420-40a8-ba55-f52088351ec1 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:16 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f74463-0a4e-4e88-a0b2-4d5b82109d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:16 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 1073741824 Nov 05 22:34:16 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf47654-db7a-4e48-8b70-359810f64a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:16 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Volume volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 (382ae2a0-17bd-4d80-b65d-d15dbfc839e4): created successfully Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf47654-db7a-4e48-8b70-359810f64a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (bb94da82-5e7f-4e0e-a2a7-9298c18a670a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b98751e4-89a4-49e6-b739-e8f24d4daef4 tempest-ProjectReaderTests-2127386985 None] Created volume successfully. Nov 05 22:34:16 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2" returned: 0 in 0.462s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22747411-5ded-4edb-86c2-353bdbd3a1c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e6018-d86a-4436-b7b2-c119500c5a94]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:17 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 1073741824" returned: 0 in 0.458s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:17 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 Nov 05 22:34:17 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:17 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 Nov 05 22:34:17 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:17 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0" returned: 0 in 0.442s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:17 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 Nov 05 22:34:17 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:17 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1" returned: 0 in 0.368s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b739479-d4ea-4087-85d2-eb5fa57fd4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0b410a-c420-40a8-ba55-f52088351ec1', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8a5fd4-e737-4d54-9357-d9851f87b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:17 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Volume volume-6b0b410a-c420-40a8-ba55-f52088351ec1 (6b0b410a-c420-40a8-ba55-f52088351ec1): created successfully Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8a5fd4-e737-4d54-9357-d9851f87b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Flow 'volume_create_manager' (3c1ba942-4c73-4e68-9cc4-f2ce5ba3f120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Creating offline snapshot 9810a7bc-e278-4d57-9ba2-b99634983d48 of volume 382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:17 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-25c1cc89-4388-4407-a91f-52d8e09c3aae tempest-ProjectReaderTests-901413739 None] Created volume successfully. Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[159d63ba-0de1-425f-bdae-1e80c6ce2952]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:17 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 Nov 05 22:34:17 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:17 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2" returned: 0 in 0.438s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:17 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2 Nov 05 22:34:17 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:18 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" returned: 0 in 0.549s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:18 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 1G Nov 05 22:34:18 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:18 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0.02f92091-3d15-4dba-baa2-4eb611026ab2" returned: 0 in 0.399s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-02f92091-3d15-4dba-baa2-4eb611026ab2" released by "_delete_snapshot" :: held 1.936s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-22747411-5ded-4edb-86c2-353bdbd3a1c0" released by "delete_snapshot" :: held 2.021s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Created reservations ['1f634367-273c-494e-a7cf-330657846f49', '1832ac72-2b11-4bd7-a3bf-ece7da46ea81', 'a5a33e65-addd-4e08-80e2-4c19b2fec676', '5d90aa71-4828-4d31-a810-08b7c4aa3065'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-6b0b410a-c420-40a8-ba55-f52088351ec1-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Lock "cinder-6b0b410a-c420-40a8-ba55-f52088351ec1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:18 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Acquiring lock "cinder-quobyte-6b0b410a-c420-40a8-ba55-f52088351ec1" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-5406703b-f967-496b-a1b5-623292b21e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-02f92091-3d15-4dba-baa2-4eb611026ab2-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-6b0b410a-c420-40a8-ba55-f52088351ec1" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c38443-d29f-44c1-a9f4-bd72bcd1d9a7]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:18 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 Nov 05 22:34:18 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:18 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 1G" returned: 0 in 0.676s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:18 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 Nov 05 22:34:18 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:19 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1" returned: 0 in 0.408s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:19 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1 Nov 05 22:34:19 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:19 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48" returned: 0 in 0.342s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:19 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 is being set with open permissions: ugo+rw Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:19 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 Nov 05 22:34:19 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:19 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6b0b410a-c420-40a8-ba55-f52088351ec1" returned: 0 in 0.295s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Lock "cinder-quobyte-6b0b410a-c420-40a8-ba55-f52088351ec1" released by "delete_volume" :: held 0.764s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:19 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48" returned: 0 in 0.279s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Created reservations ['73e92b74-7b6f-428d-b189-fd4d69aea209', '74773ed8-4911-4f1f-b88c-648efc19d661', '4ae996b8-eb4f-4e3a-836f-d3a3eebd622d', 'f7864150-7c24-4a75-a611-2f53fa7d298a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-22747411-5ded-4edb-86c2-353bdbd3a1c0-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:19 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.info Nov 05 22:34:19 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Lock "cinder-22747411-5ded-4edb-86c2-353bdbd3a1c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-22747411-5ded-4edb-86c2-353bdbd3a1c0" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-22747411-5ded-4edb-86c2-353bdbd3a1c0" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af9aeab-fb7f-4173-a798-e7a93de22ef6]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:19 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:19 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:19 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 Nov 05 22:34:19 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:19 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.info" returned: 0 in 0.453s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:19 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.info is being set with open permissions: ugo+rw Nov 05 22:34:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:20 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.info Nov 05 22:34:20 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:20 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.442s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Deleted volume successfully. Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-dcb8d478-2a17-466a-b19e-6ca70360f6b1 tempest-ProjectReaderTests-901413739 None] Lock "cinder-6b0b410a-c420-40a8-ba55-f52088351ec1-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:20 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0" returned: 0 in 0.572s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:20 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0 Nov 05 22:34:20 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:20 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.info" returned: 0 in 0.431s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:20 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9f61721a-65dd-42fa-96ac-127c57e95681 tempest-ProjectReaderTests-2127386985 None] Create snapshot completed successfully Nov 05 22:34:20 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-22747411-5ded-4edb-86c2-353bdbd3a1c0" returned: 0 in 0.291s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-22747411-5ded-4edb-86c2-353bdbd3a1c0" released by "delete_volume" :: held 1.004s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Created reservations ['ef32b610-29eb-48fd-9670-f2eae712426c', '9eec8b9f-a164-48a9-8451-2bfaed0b7e0f', '2e2752da-f4b2-415c-aed7-8cc78218f1f8', '669d9ee2-98b1-41b6-8274-f94c22cd90f8'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-9810a7bc-e278-4d57-9ba2-b99634983d48-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-9810a7bc-e278-4d57-9ba2-b99634983d48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:20 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:20 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-9810a7bc-e278-4d57-9ba2-b99634983d48" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-9810a7bc-e278-4d57-9ba2-b99634983d48" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Deleting offline snapshot 9810a7bc-e278-4d57-9ba2-b99634983d48 of volume 382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] snapshot_file for this snap is: volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01a484-12e7-4b91-837a-13847557c67c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:21 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 Nov 05 22:34:21 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:21 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.373s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8c72a603-a9ea-4029-b380-a83bf9272064 tempest-ProjectMemberTests-533561658 None] Lock "cinder-22747411-5ded-4edb-86c2-353bdbd3a1c0-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:21 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48" returned: 0 in 0.575s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a55fbf-8edc-4ae2-9973-8f2a234174b2]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:21 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 Nov 05 22:34:21 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:22 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" returned: 0 in 0.460s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:22 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 Nov 05 22:34:22 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:22 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (a43bf57f-1a29-4a50-82f9-1b0d5b3606a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab576a-e0c8-47d7-a5e5-007cbe8f4ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48" returned: 0 in 0.564s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab576a-e0c8-47d7-a5e5-007cbe8f4ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184361859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c66023e-f4eb-4827-9118-067a47ab41dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:23Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:22 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48 Nov 05 22:34:22 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff6a6d4-7c9d-4400-b6e3-2f656d127141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff6a6d4-7c9d-4400-b6e3-2f656d127141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df758e1-3a67-4a35-bece-5da3a8449f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df758e1-3a67-4a35-bece-5da3a8449f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c66023e-f4eb-4827-9118-067a47ab41dd', 'volume_name': 'volume-7c66023e-f4eb-4827-9118-067a47ab41dd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98cd98-fa37-48f8-8bda-4ceff93d1458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e98cd98-fa37-48f8-8bda-4ceff93d1458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b2ec51-9d8e-4763-9e40-094d428998ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:22 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Volume 7c66023e-f4eb-4827-9118-067a47ab41dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c66023e-f4eb-4827-9118-067a47ab41dd', 'volume_size': 1} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184361859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c66023e-f4eb-4827-9118-067a47ab41dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:23Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Creating volume 7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:22 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:22 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd 1073741824 Nov 05 22:34:22 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:22 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4.9810a7bc-e278-4d57-9ba2-b99634983d48" returned: 0 in 0.307s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-9810a7bc-e278-4d57-9ba2-b99634983d48" released by "_delete_snapshot" :: held 2.056s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" released by "delete_snapshot" :: held 2.093s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Created reservations ['10793c93-ba3e-4d46-b51b-b1b5662d301b', '7b41364b-07da-4ea1-8202-06f9ee6df4bf', '0451bc74-9515-4370-8d70-a41baa7e2f77', 'f2df8e8b-05e6-40ea-bebb-e343f54397dc'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Delete snapshot completed successfully. Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e1193379-890c-49f3-ad78-bbf9b718c9a5 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-9810a7bc-e278-4d57-9ba2-b99634983d48-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:23 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd 1073741824" returned: 0 in 0.519s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:23 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd Nov 05 22:34:23 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:23 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd" returned: 0 in 0.279s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b2ec51-9d8e-4763-9e40-094d428998ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c66023e-f4eb-4827-9118-067a47ab41dd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d2775f-a461-4224-8091-af3263813a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:23 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Volume volume-7c66023e-f4eb-4827-9118-067a47ab41dd (7c66023e-f4eb-4827-9118-067a47ab41dd): created successfully Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d2775f-a461-4224-8091-af3263813a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:23 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (a43bf57f-1a29-4a50-82f9-1b0d5b3606a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-32df17eb-300d-49a9-8df0-5b82e0ba9bbd tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-382ae2a0-17bd-4d80-b65d-d15dbfc839e4-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-382ae2a0-17bd-4d80-b65d-d15dbfc839e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa4025-808b-473f-ab3e-aa8a41cbc867]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:24 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 Nov 05 22:34:24 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:24 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" returned: 0 in 0.433s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:24 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4 Nov 05 22:34:24 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Creating offline snapshot a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 of volume 7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1ed61-b6c7-4767-af10-95e20d96544e]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:24 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:25 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" returned: 0 in 0.294s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-382ae2a0-17bd-4d80-b65d-d15dbfc839e4" released by "delete_volume" :: held 0.817s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:25 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd Nov 05 22:34:25 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Created reservations ['3c32325a-bede-44ff-9c9b-ab4f031679ad', 'dfafeadd-c120-4829-b531-fe1e9e46bc37', '191ca59d-f504-4d0f-a762-bcbb36de2c7b', 'e2917a1f-9e8d-426f-9a61-03455031a87f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:25 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:25 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:25 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd" returned: 0 in 0.481s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:25 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 1G Nov 05 22:34:25 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:25 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.320s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:25 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Deleted volume successfully. Nov 05 22:34:25 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-067ba6d4-2518-4c30-a7bf-7b18fc3d6837 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-382ae2a0-17bd-4d80-b65d-d15dbfc839e4-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (cd52929d-1191-4c3e-992e-25d2c56c48e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5292a63f-667b-46ca-989e-70db9d8bdc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5292a63f-667b-46ca-989e-70db9d8bdc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712833633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87af03bf-9c9d-4c41-a8a9-c87ab9629436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:26Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7387587b-586b-4647-aaaa-51ed10621d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7387587b-586b-4647-aaaa-51ed10621d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21c6332-5a39-4d84-b35a-f9f76f83719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21c6332-5a39-4d84-b35a-f9f76f83719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87af03bf-9c9d-4c41-a8a9-c87ab9629436', 'volume_name': 'volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1854f803-279d-49d5-90fb-fa98bd8139e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1854f803-279d-49d5-90fb-fa98bd8139e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f0b17-bd9e-45e5-a0cf-67b629775195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:26 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Volume 87af03bf-9c9d-4c41-a8a9-c87ab9629436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436', 'volume_size': 1} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 1G" returned: 0 in 0.669s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c66023e-f4eb-4827-9118-067a47ab41dd -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:26 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c66023e-f4eb-4827-9118-067a47ab41dd -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 Nov 05 22:34:26 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:26 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c66023e-f4eb-4827-9118-067a47ab41dd -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" returned: 0 in 0.321s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:26 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 is being set with open permissions: ugo+rw Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:26 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 Nov 05 22:34:26 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:26 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" returned: 0 in 0.252s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:26 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:26 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.info Nov 05 22:34:26 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:27 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.info" returned: 0 in 0.279s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:27 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.info is being set with open permissions: ugo+rw Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:27 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.info Nov 05 22:34:27 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:27 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.info" returned: 0 in 0.264s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.365s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712833633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87af03bf-9c9d-4c41-a8a9-c87ab9629436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:26Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Creating volume 87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:27 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:27 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 1073741824 Nov 05 22:34:27 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:27 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ea46b434-c934-4d01-a35c-685e66f51a1b tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:34:27 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 1073741824" returned: 0 in 0.492s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:27 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:27 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 Nov 05 22:34:27 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:28 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436" returned: 0 in 0.270s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-a6c7ee1a-047a-40a3-b907-b0fc35bd5c68-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f0b17-bd9e-45e5-a0cf-67b629775195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6317dd7e-40c0-445d-98c2-3480d75edce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:28 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Volume volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 (87af03bf-9c9d-4c41-a8a9-c87ab9629436): created successfully Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6317dd7e-40c0-445d-98c2-3480d75edce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (cd52929d-1191-4c3e-992e-25d2c56c48e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Lock "cinder-a6c7ee1a-047a-40a3-b907-b0fc35bd5c68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-7c66023e-f4eb-4827-9118-067a47ab41dd" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-7c66023e-f4eb-4827-9118-067a47ab41dd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:28 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-55df2c0a-593a-4468-8565-2cff8693d183 tempest-ProjectReaderTests-2127386985 None] Created volume successfully. Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 of volume 7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a724c-2cd8-433d-be07-5bcd00035d0b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:28 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 Nov 05 22:34:28 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:28 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" returned: 0 in 0.384s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c66023e-f4eb-4827-9118-067a47ab41dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a6a5d-1fc8-4efe-b797-14b7422dc8d2]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:28 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:28 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd Nov 05 22:34:28 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:29 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd" returned: 0 in 0.383s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:29 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 Nov 05 22:34:29 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Creating offline snapshot 72c6cf22-10f2-4f03-b409-b458a1b3906a of volume 87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a4463c-9d7e-4889-bafa-d0ee5e7c3880]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:29 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" returned: 0 in 0.467s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:29 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68 Nov 05 22:34:29 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:29 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 Nov 05 22:34:29 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:29 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd.a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-a6c7ee1a-047a-40a3-b907-b0fc35bd5c68" released by "_delete_snapshot" :: held 1.656s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-7c66023e-f4eb-4827-9118-067a47ab41dd" released by "delete_snapshot" :: held 1.691s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:29 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436" returned: 0 in 0.416s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:29 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a 1G Nov 05 22:34:29 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:29 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Created reservations ['b287184b-2c33-4323-aea3-be92e18cd723', '2793c007-299b-454d-b65a-3928fe7cb8ae', '0acad23b-50e3-474a-ac7e-c217b4b6f3c3', 'b8c6d459-6187-48e9-9fb2-e71b3c621f3f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:30 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-24b6c9f3-e712-4c3d-9001-dd38dabd688a tempest-ProjectMemberTests-533561658 None] Lock "cinder-a6c7ee1a-047a-40a3-b907-b0fc35bd5c68-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-7c66023e-f4eb-4827-9118-067a47ab41dd-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-7c66023e-f4eb-4827-9118-067a47ab41dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-7c66023e-f4eb-4827-9118-067a47ab41dd" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:30 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a 1G" returned: 0 in 0.504s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-7c66023e-f4eb-4827-9118-067a47ab41dd" acquired by "delete_volume" :: waited 0.038s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:30 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a Nov 05 22:34:30 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86c8ec0-57c9-4d75-8415-3bee63db0c18]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:30 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd Nov 05 22:34:30 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:30 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a" returned: 0 in 0.344s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:30 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a is being set with open permissions: ugo+rw Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:30 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a Nov 05 22:34:30 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:30 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd" returned: 0 in 0.402s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:30 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:30 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd Nov 05 22:34:30 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:31 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a" returned: 0 in 0.379s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:31 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.info Nov 05 22:34:31 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:31 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7c66023e-f4eb-4827-9118-067a47ab41dd" returned: 0 in 0.368s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-7c66023e-f4eb-4827-9118-067a47ab41dd" released by "delete_volume" :: held 0.855s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Created reservations ['06d8712b-e0b1-4414-90e5-bf93c2368c2c', '1a1b0a8e-2d27-4801-bce1-3222b1e840e5', '8bbc134a-5d46-4343-9d63-e1066e6a33da', '30c9dd15-530c-4259-a2f6-2eeadd6a7c3e'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:31 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:31 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:31 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.info" returned: 0 in 0.366s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:31 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.info is being set with open permissions: ugo+rw Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:31 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.info Nov 05 22:34:31 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:31 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.403s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:31 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-af9e1ca1-9796-46d8-8bab-f9d8d7e9efd3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-7c66023e-f4eb-4827-9118-067a47ab41dd-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:31 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:31 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.info" returned: 0 in 0.426s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:32 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-2aef23f1-9eb8-4d7c-9b7a-35cf079aa7e7 tempest-ProjectReaderTests-2127386985 None] Create snapshot completed successfully Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (48192ae6-1fce-4fa7-acd9-b97f46ab428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bc8fb5-e829-4549-930f-418e8103a0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bc8fb5-e829-4549-930f-418e8103a0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598603824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:32Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8629ba1-4c58-40ba-a90c-2db145344cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8629ba1-4c58-40ba-a90c-2db145344cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409e06fa-4049-4068-82a4-0363c06c5ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409e06fa-4049-4068-82a4-0363c06c5ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8', 'volume_name': 'volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d7d3b4-aa23-41b5-a7e6-ecfa910ecf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d7d3b4-aa23-41b5-a7e6-ecfa910ecf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a12b570-fe69-47fb-b35b-63176bb0667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:32 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Volume 9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8', 'volume_size': 1} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598603824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:32Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Creating volume 9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:32 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:32 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 1073741824 Nov 05 22:34:32 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-72c6cf22-10f2-4f03-b409-b458a1b3906a-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-72c6cf22-10f2-4f03-b409-b458a1b3906a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-87af03bf-9c9d-4c41-a8a9-c87ab9629436" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-87af03bf-9c9d-4c41-a8a9-c87ab9629436" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-72c6cf22-10f2-4f03-b409-b458a1b3906a" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-72c6cf22-10f2-4f03-b409-b458a1b3906a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Deleting offline snapshot 72c6cf22-10f2-4f03-b409-b458a1b3906a of volume 87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:32 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] snapshot_file for this snap is: volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 1073741824" returned: 0 in 0.603s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da95e0b-b141-4076-9eba-4ed6b0966c24]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:32 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:32 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 Nov 05 22:34:32 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:33 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a Nov 05 22:34:33 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:33 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" returned: 0 in 0.438s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a12b570-fe69-47fb-b35b-63176bb0667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fb3c20-e580-4197-b774-9dac910bbd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:33 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:33 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Volume volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 (9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8): created successfully Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fb3c20-e580-4197-b774-9dac910bbd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (48192ae6-1fce-4fa7-acd9-b97f46ab428b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a" returned: 0 in 0.543s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:33 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-b0585f93-e5c2-41e3-9134-04eff79707d9 tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f65c3d-1f03-4e9e-b047-f79ee439dd09]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:33 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 Nov 05 22:34:33 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:33 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436" returned: 0 in 0.404s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:33 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:33 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a Nov 05 22:34:33 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:34 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a" returned: 0 in 0.410s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:34 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a Nov 05 22:34:34 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Creating offline snapshot 91b9122b-8c83-4196-8120-12969ea9c64e of volume 9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5926b95-ab8c-4396-a255-170c3b44231c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:34 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436.72c6cf22-10f2-4f03-b409-b458a1b3906a" returned: 0 in 0.346s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-72c6cf22-10f2-4f03-b409-b458a1b3906a" released by "_delete_snapshot" :: held 1.878s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-87af03bf-9c9d-4c41-a8a9-c87ab9629436" released by "delete_snapshot" :: held 1.911s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:34 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 Nov 05 22:34:34 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Created reservations ['2cf101f1-0c54-4e2e-a0a9-adf4a188e24a', '8d590ef4-8e38-4dad-8806-59255d5316b4', 'cbe8242c-b241-45a5-91d9-815b03fb2af4', '58d005c4-220b-4454-b49e-0a05b79d3dec'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:34 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Delete snapshot completed successfully. Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-55dc7bb5-a33e-4a09-8fe7-ad9f892036b7 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-72c6cf22-10f2-4f03-b409-b458a1b3906a-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-87af03bf-9c9d-4c41-a8a9-c87ab9629436-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:34 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-87af03bf-9c9d-4c41-a8a9-c87ab9629436-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-87af03bf-9c9d-4c41-a8a9-c87ab9629436" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-87af03bf-9c9d-4c41-a8a9-c87ab9629436" acquired by "delete_volume" :: waited 0.023s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa08ad4-0657-494c-b9b0-aa94183914e1]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:35 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" returned: 0 in 0.677s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:35 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e 1G Nov 05 22:34:35 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:35 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 Nov 05 22:34:35 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:35 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436" returned: 0 in 0.443s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:35 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436 Nov 05 22:34:35 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:35 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e 1G" returned: 0 in 0.490s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:35 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e Nov 05 22:34:35 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:35 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-87af03bf-9c9d-4c41-a8a9-c87ab9629436" returned: 0 in 0.293s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-87af03bf-9c9d-4c41-a8a9-c87ab9629436" released by "delete_volume" :: held 0.818s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:35 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Created reservations ['2d05e7f1-24e5-438b-b86a-36563e1a7da0', 'b06e08e2-6d07-4824-b1c1-f181a4d567e7', '9e498bbc-b822-41ec-b61c-cc21b64e8515', '9b3252e5-4c58-432c-85df-039070516625'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:36 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e" returned: 0 in 0.403s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e is being set with open permissions: ugo+rw Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:36 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:36 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:36 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e Nov 05 22:34:36 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Flow 'volume_create_manager' (104bc0fd-e84a-4dea-be0a-24974c32c5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e96d035-ce49-4346-9d9b-d705383d89f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e96d035-ce49-4346-9d9b-d705383d89f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1916049999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6e16fa-5cc1-4477-89f8-d5c7be67a146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d75d458122f421687eca8ee2fe1890d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:36Z,use_quota=True,user_id='702664171198425d9230663c56ce24cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44186be6-93e2-4266-9d94-b7ed21559a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44186be6-93e2-4266-9d94-b7ed21559a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f09881-ce96-47bd-a12f-2f8e187f5121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86f09881-ce96-47bd-a12f-2f8e187f5121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6e16fa-5cc1-4477-89f8-d5c7be67a146', 'volume_name': 'volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68759fa-d3c7-44dd-ad1d-998f70dba522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68759fa-d3c7-44dd-ad1d-998f70dba522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b215a40-ee59-44ef-adde-731c9fde6b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Volume 3f6e16fa-5cc1-4477-89f8-d5c7be67a146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146', 'volume_size': 1} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:36 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.306s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Deleted volume successfully. Nov 05 22:34:36 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-8bcfd5d6-d2c3-49dc-9f88-403fd4ebb614 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-87af03bf-9c9d-4c41-a8a9-c87ab9629436-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e" returned: 0 in 0.334s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:36 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.info Nov 05 22:34:36 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (c4297c8f-70b0-4ef5-b91c-3e4f00d9fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:36 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f630ef-7044-49ca-9160-bb271269941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.info" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.info is being set with open permissions: ugo+rw Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f630ef-7044-49ca-9160-bb271269941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870586141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad153203-c9d9-4f56-aadd-0872c2da69a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:37Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.info Nov 05 22:34:36 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24c164f-7c78-412c-842c-bbc07a92476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24c164f-7c78-412c-842c-bbc07a92476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cf162d-b2d1-43d9-81cc-1615df359cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cf162d-b2d1-43d9-81cc-1615df359cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad153203-c9d9-4f56-aadd-0872c2da69a7', 'volume_name': 'volume-ad153203-c9d9-4f56-aadd-0872c2da69a7', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3b86de-5024-4c80-a51d-cf4f9418c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3b86de-5024-4c80-a51d-cf4f9418c654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee610b6c-a5da-49b1-b7f0-ae243a140288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:36 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Volume ad153203-c9d9-4f56-aadd-0872c2da69a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad153203-c9d9-4f56-aadd-0872c2da69a7', 'volume_size': 1} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:36 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.info" returned: 0 in 0.256s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1916049999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6e16fa-5cc1-4477-89f8-d5c7be67a146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d75d458122f421687eca8ee2fe1890d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:36Z,use_quota=True,user_id='702664171198425d9230663c56ce24cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Creating volume 3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:37 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:37 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 1073741824 Nov 05 22:34:37 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7384c27e-ca53-4e27-8517-1afd23ef4792 tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:34:37 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 1073741824" returned: 0 in 0.435s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:37 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 Nov 05 22:34:37 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-91b9122b-8c83-4196-8120-12969ea9c64e-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-91b9122b-8c83-4196-8120-12969ea9c64e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-91b9122b-8c83-4196-8120-12969ea9c64e" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-91b9122b-8c83-4196-8120-12969ea9c64e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot 91b9122b-8c83-4196-8120-12969ea9c64e of volume 9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:37 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" returned: 0 in 0.254s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.946s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-870586141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad153203-c9d9-4f56-aadd-0872c2da69a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:37Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Creating volume ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:37 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[118873f6-e381-42a1-a62f-a58fda5c9e13]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:37 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 1073741824 Nov 05 22:34:37 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b215a40-ee59-44ef-adde-731c9fde6b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2fec48-1ca5-4a14-99c3-92239a183fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:37 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Volume volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 (3f6e16fa-5cc1-4477-89f8-d5c7be67a146): created successfully Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2fec48-1ca5-4a14-99c3-92239a183fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:37 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Flow 'volume_create_manager' (104bc0fd-e84a-4dea-be0a-24974c32c5b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-5877731f-6e05-4227-aa63-6233f86fbe27 tempest-SnapshotDependencyTests-1863963495 None] Created volume successfully. Nov 05 22:34:37 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e Nov 05 22:34:37 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:38 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e" returned: 0 in 0.393s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c00dac-d8b4-4c2c-9a54-c45d4d3079ab]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:38 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 1073741824" returned: 0 in 0.499s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:38 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 Nov 05 22:34:38 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:38 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 Nov 05 22:34:38 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:38 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7" returned: 0 in 0.392s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.049s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:38 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Creating offline snapshot 0d246834-0bc0-4f53-866e-46331fa7c663 of volume 3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" returned: 0 in 0.496s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc03714-7798-4622-b359-eeba52363aaa]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:38 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e Nov 05 22:34:38 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee610b6c-a5da-49b1-b7f0-ae243a140288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad153203-c9d9-4f56-aadd-0872c2da69a7', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df65fc7-188f-4f89-8560-148281b31ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:38 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Volume volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 (ad153203-c9d9-4f56-aadd-0872c2da69a7): created successfully Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df65fc7-188f-4f89-8560-148281b31ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (c4297c8f-70b0-4ef5-b91c-3e4f00d9fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-734672fb-4cd1-4a42-8602-1ce4feebf1b8 tempest-ProjectReaderTests-2127386985 None] Created volume successfully. Nov 05 22:34:38 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 Nov 05 22:34:38 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:39 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e" returned: 0 in 0.324s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:39 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e Nov 05 22:34:39 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:39 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:39 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 1G Nov 05 22:34:39 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:39 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8.91b9122b-8c83-4196-8120-12969ea9c64e" returned: 0 in 0.260s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-91b9122b-8c83-4196-8120-12969ea9c64e" released by "_delete_snapshot" :: held 1.652s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" released by "delete_snapshot" :: held 1.675s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Created reservations ['7074a327-3225-4bf3-997c-ba04a49e478e', '00bb9471-6e99-44d0-9641-7ac4ded27b9a', 'dd2945f9-e913-44d4-9851-44dab5a4b2f9', 'd5d831b6-0b42-4915-8297-f3fe71b87b33'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:39 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3fd69ba6-1b13-4c9c-a647-ba03aab70ac3 tempest-ProjectMemberTests-533561658 None] Lock "cinder-91b9122b-8c83-4196-8120-12969ea9c64e-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:39 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 1G" returned: 0 in 0.433s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:39 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 Nov 05 22:34:39 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Lock "cinder-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:39 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663" returned: 0 in 0.345s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:39 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 is being set with open permissions: ugo+rw Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" acquired by "delete_volume" :: waited 0.034s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:39 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 Nov 05 22:34:39 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb3f98e-316b-4a69-9058-8d647a743f71]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:40 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 Nov 05 22:34:40 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:40 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663" returned: 0 in 0.276s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:40 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.info Nov 05 22:34:40 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:40 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:40 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:40 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" returned: 0 in 0.416s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:40 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8 Nov 05 22:34:40 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:40 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.info" returned: 0 in 0.288s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:40 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.info is being set with open permissions: ugo+rw Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:40 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.info Nov 05 22:34:40 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:40 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.273s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:34:40 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" returned: 0 in 0.273s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8" released by "delete_volume" :: held 0.763s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Created reservations ['7cd641ef-bbfe-4880-82da-0554b2a4279a', '2607a299-5390-4c4d-8bc7-08173beebf8f', 'c176f99c-b822-433d-bbdd-5694408e2a88', '58836914-bd33-4f6f-8da3-3db7b9b6637f'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:40 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.info" returned: 0 in 0.271s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.727s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Creating offline snapshot 0379f137-1965-41f3-9c24-15083489f982 of volume ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-62d6d7cc-b6ee-414f-a959-f07a8b5930f9 tempest-SnapshotDependencyTests-1863963495 None] Create snapshot completed successfully Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[550a63ee-5369-40ee-ab99-e1357888ded2]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:40 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:40 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:40 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 Nov 05 22:34:40 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:41 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:41 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-05abedcd-a11e-49f2-8838-ddb7244708eb tempest-ProjectMemberTests-533561658 None] Lock "cinder-9df1f2e5-cfe4-4d8c-b9f9-3df02c4900c8-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:41 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7" returned: 0 in 0.432s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:41 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 1G Nov 05 22:34:41 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (6f5b21ab-47e3-4093-b480-151917f6f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f40804-4265-40da-9dee-1b2dc95f08e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f40804-4265-40da-9dee-1b2dc95f08e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236583011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e07bd1-b51e-496e-898b-2e85cd5c42cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:41Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b0f15e-f9e8-4679-b5e8-87149d87e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3b0f15e-f9e8-4679-b5e8-87149d87e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edeeda2d-6792-4cd2-a527-9f6f877b06bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edeeda2d-6792-4cd2-a527-9f6f877b06bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e07bd1-b51e-496e-898b-2e85cd5c42cd', 'volume_name': 'volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76fadf0-bf12-4816-87ad-d838d0c6bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76fadf0-bf12-4816-87ad-d838d0c6bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b355fc01-c863-41dc-8c2a-a82623514db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:41 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Volume 81e07bd1-b51e-496e-898b-2e85cd5c42cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd', 'volume_size': 1} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:41 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 1G" returned: 0 in 0.466s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:41 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:41 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 Nov 05 22:34:41 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:42 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982" returned: 0 in 0.301s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:42 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 is being set with open permissions: ugo+rw Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:42 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 Nov 05 22:34:42 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:42 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Flow 'volume_create_manager' (b06a291a-a5cc-4bb4-8084-26af35d80b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04926d47-b5e2-4d80-8c9e-cc505d04c938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982" returned: 0 in 0.310s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04926d47-b5e2-4d80-8c9e-cc505d04c938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca69190e-e33d-453d-b133-b55f554d6198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d75d458122f421687eca8ee2fe1890d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d246834-0bc0-4f53-866e-46331fa7c663,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:42Z,use_quota=True,user_id='702664171198425d9230663c56ce24cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfa3b1b-f950-4cec-b6eb-a838717e31d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfa3b1b-f950-4cec-b6eb-a838717e31d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9244f97c-a9a1-4999-9e45-88912335f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9244f97c-a9a1-4999-9e45-88912335f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca69190e-e33d-453d-b133-b55f554d6198', 'volume_name': 'volume-ca69190e-e33d-453d-b133-b55f554d6198', 'volume_size': 1, 'snapshot_id': '0d246834-0bc0-4f53-866e-46331fa7c663'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c55eba1-48ee-4eb7-b8ac-726035538273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c55eba1-48ee-4eb7-b8ac-726035538273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6282f7ed-a0fc-452f-9a8e-6cab36d16087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:42 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Volume ca69190e-e33d-453d-b133-b55f554d6198: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca69190e-e33d-453d-b133-b55f554d6198', 'volume_size': 1, 'snapshot_id': '0d246834-0bc0-4f53-866e-46331fa7c663'} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:42 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.info Nov 05 22:34:42 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:42 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.info" returned: 0 in 0.261s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:42 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.info is being set with open permissions: ugo+rw Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:42 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.info Nov 05 22:34:42 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:42 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.info" returned: 0 in 0.242s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236583011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e07bd1-b51e-496e-898b-2e85cd5c42cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:41Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Creating volume 81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:42 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:42 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:42 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd 1073741824 Nov 05 22:34:42 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:42 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-7810207b-bf1d-46d0-9f7d-44267e41c491 tempest-ProjectReaderTests-2127386985 None] Create snapshot completed successfully Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-0379f137-1965-41f3-9c24-15083489f982-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-0379f137-1965-41f3-9c24-15083489f982-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-ad153203-c9d9-4f56-aadd-0872c2da69a7" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-ad153203-c9d9-4f56-aadd-0872c2da69a7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-0379f137-1965-41f3-9c24-15083489f982" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-0379f137-1965-41f3-9c24-15083489f982" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Deleting offline snapshot 0379f137-1965-41f3-9c24-15083489f982 of volume ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] snapshot_file for this snap is: volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c629e8e-d40c-42d1-8929-6c775955f0f5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:43 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd 1073741824" returned: 0 in 0.492s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:43 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 Nov 05 22:34:43 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:43 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd Nov 05 22:34:43 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:43 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982" returned: 0 in 0.378s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad153203-c9d9-4f56-aadd-0872c2da69a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:43 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee7aa50-445a-4db4-9e18-16628cfc50a9]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd" returned: 0 in 0.277s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.336s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-quobyte-0d246834-0bc0-4f53-866e-46331fa7c663-ca69190e-e33d-453d-b133-b55f554d6198" by "_create_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b355fc01-c863-41dc-8c2a-a82623514db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a121fa14-6d31-42ff-982c-039b3b8fb6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-0d246834-0bc0-4f53-866e-46331fa7c663-ca69190e-e33d-453d-b133-b55f554d6198" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Creating volume ca69190e-e33d-453d-b133-b55f554d6198 from snapshot 0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-quobyte-ca69190e-e33d-453d-b133-b55f554d6198" by "_copy_volume_from_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:43 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Volume volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd (81e07bd1-b51e-496e-898b-2e85cd5c42cd): created successfully Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a121fa14-6d31-42ff-982c-039b3b8fb6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (6f5b21ab-47e3-4093-b480-151917f6f30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-ca69190e-e33d-453d-b133-b55f554d6198" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] snapshot: 0d246834-0bc0-4f53-866e-46331fa7c663, volume: ca69190e-e33d-453d-b133-b55f554d6198, {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 22:34:43 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-eaabb509-ce24-469e-9886-b8647f0b997b tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:34:43 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 Nov 05 22:34:43 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fbae2b-2aea-46a0-aca6-6c8d7455371f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:43 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:44 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 Nov 05 22:34:44 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7" returned: 0 in 0.391s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:44 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 Nov 05 22:34:44 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663" returned: 0 in 0.395s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcd48a-41a7-4924-87aa-8db84f0c654a]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:44 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 Nov 05 22:34:44 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982" returned: 0 in 0.390s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:44 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982 Nov 05 22:34:44 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" returned: 0 in 0.379s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Creating direct copy from snapshot {{(pid=87085) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.utils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Path /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 not found in is_blk_device check {{(pid=87085) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:44 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 Nov 05 22:34:44 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:44 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7.0379f137-1965-41f3-9c24-15083489f982" returned: 0 in 0.261s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-0379f137-1965-41f3-9c24-15083489f982" released by "_delete_snapshot" :: held 1.536s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-ad153203-c9d9-4f56-aadd-0872c2da69a7" released by "delete_snapshot" :: held 1.562s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Created reservations ['70271fde-14b8-4902-96c5-3707fe1bd75d', '5e84feb8-5cb1-439b-9169-9b4b8c5a1bd5', '465f379d-6e01-441e-82fe-fd82e3c7a8c4', '2bd8acd7-3e14-4df1-a54e-ba86b3e39263'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:44 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Delete snapshot completed successfully. Nov 05 22:34:44 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-c9378eea-af46-459a-8f51-2ecb1c5ca1d3 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-0379f137-1965-41f3-9c24-15083489f982-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-ad153203-c9d9-4f56-aadd-0872c2da69a7-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-ad153203-c9d9-4f56-aadd-0872c2da69a7-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-ad153203-c9d9-4f56-aadd-0872c2da69a7" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:45 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-ad153203-c9d9-4f56-aadd-0872c2da69a7" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:45 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f988892a-194f-4bc3-9376-b7b6cbced99c]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:45 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:46 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 Nov 05 22:34:46 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:46 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7" returned: 0 in 0.849s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:46 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:46 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7 Nov 05 22:34:46 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:47 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ad153203-c9d9-4f56-aadd-0872c2da69a7" returned: 0 in 0.478s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-ad153203-c9d9-4f56-aadd-0872c2da69a7" released by "delete_volume" :: held 1.481s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Created reservations ['65dad7b4-5bf7-4045-a5b3-4c7e5127b4b7', 'ff77b184-62a5-4bec-9e9d-29c4642c2050', '87fb7df7-b4c0-4347-856a-46df9dcef444', '5c74982e-5633-41e2-be71-41f1a964d941'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:47 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:47 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:47 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.297s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:47 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Deleted volume successfully. Nov 05 22:34:47 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3c63aa5f-73e2-4f46-b20d-f6ebf372a4b8 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-ad153203-c9d9-4f56-aadd-0872c2da69a7-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (32c2aa27-0c7c-4b8f-96f3-a34f34ae98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca0aa35-3b34-4ba9-b957-21206a3cf557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca0aa35-3b34-4ba9-b957-21206a3cf557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681089196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0bb69f-087a-446f-b7ca-3bbee1e99374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:49Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c941c7d-b075-4f76-8f3f-d1fddfb85453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c941c7d-b075-4f76-8f3f-d1fddfb85453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b79ca0-931d-4355-9c27-6d5f846c85ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b79ca0-931d-4355-9c27-6d5f846c85ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0bb69f-087a-446f-b7ca-3bbee1e99374', 'volume_name': 'volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff585812-858d-4186-95b9-7d83a97faacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff585812-858d-4186-95b9-7d83a97faacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12317bc-5bc7-4571-ac00-e5e937d4632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:48 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Volume 7a0bb69f-087a-446f-b7ca-3bbee1e99374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374', 'volume_size': 1} Nov 05 22:34:48 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:51 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198" returned: 0 in 6.424s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.image.image_utils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Image conversion details: src /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 {{(pid=87085) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 22:34:51 devstack cinder-volume[87085]: INFO cinder.image.image_utils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Converted 1024.00 MB image at 159.37 MB/s Nov 05 22:34:51 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 is being set with open permissions: ugo+rw Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:51 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 Nov 05 22:34:51 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:51 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198" returned: 0 in 0.248s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-ca69190e-e33d-453d-b133-b55f554d6198" released by "_copy_volume_from_snapshot" :: held 7.556s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-0d246834-0bc0-4f53-866e-46331fa7c663-ca69190e-e33d-453d-b133-b55f554d6198" released by "_create_volume_from_snapshot" :: held 7.633s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.670s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.291s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Creating offline snapshot f8aa9b57-35d1-4d20-a95c-210f0d662fb8 of volume 81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6282f7ed-a0fc-452f-9a8e-6cab36d16087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca69190e-e33d-453d-b133-b55f554d6198', 'volume_size': 1, 'snapshot_id': '0d246834-0bc0-4f53-866e-46331fa7c663'}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226db330-e57c-49a8-8ccc-589cd139ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[1214b0c1-0904-4d5b-96e7-47d987e4a931]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:51 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Volume volume-ca69190e-e33d-453d-b133-b55f554d6198 (ca69190e-e33d-453d-b133-b55f554d6198): created successfully Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226db330-e57c-49a8-8ccc-589cd139ed69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Flow 'volume_create_manager' (b06a291a-a5cc-4bb4-8084-26af35d80b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:51 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-be93a873-5778-4de8-8cf5-4381e02e0f04 tempest-SnapshotDependencyTests-1863963495 None] Created volume successfully. Nov 05 22:34:51 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd Nov 05 22:34:51 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:51 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd" returned: 0 in 0.358s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:51 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:51 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 1G Nov 05 22:34:51 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:52 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 1G" returned: 0 in 0.400s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-0d246834-0bc0-4f53-866e-46331fa7c663-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:52 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 Nov 05 22:34:52 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-0d246834-0bc0-4f53-866e-46331fa7c663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-quobyte-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-quobyte-0d246834-0bc0-4f53-866e-46331fa7c663" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-0d246834-0bc0-4f53-866e-46331fa7c663" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Deleting offline snapshot 0d246834-0bc0-4f53-866e-46331fa7c663 of volume 3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] snapshot_file for this snap is: volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b51fd8-d62b-4829-9463-fdad9199fe77]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:52 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 Nov 05 22:34:52 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:52 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8" returned: 0 in 0.309s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:52 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 is being set with open permissions: ugo+rw Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:52 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 Nov 05 22:34:52 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:52 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663" returned: 0 in 0.377s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbedb30-4265-4027-ba0b-11eae02f3128]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:52 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8" returned: 0 in 0.256s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:52 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:52 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.info Nov 05 22:34:52 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:52 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 Nov 05 22:34:52 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.info" returned: 0 in 0.262s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:53 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.info is being set with open permissions: ugo+rw Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.info Nov 05 22:34:53 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" returned: 0 in 0.567s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.info" returned: 0 in 0.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:53 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 Nov 05 22:34:53 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.476s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681089196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0bb69f-087a-446f-b7ca-3bbee1e99374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8f04fe6c9d4e01b3ca40d18f606e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:49Z,use_quota=True,user_id='aaa9d96059ef41b79d6df4e9e5844fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Creating volume 7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:53 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 1073741824 Nov 05 22:34:53 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-30369e1c-ef7f-4907-ae3d-7ff896d7bf41 tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-f8aa9b57-35d1-4d20-a95c-210f0d662fb8-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-f8aa9b57-35d1-4d20-a95c-210f0d662fb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-81e07bd1-b51e-496e-898b-2e85cd5c42cd" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-81e07bd1-b51e-496e-898b-2e85cd5c42cd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-f8aa9b57-35d1-4d20-a95c-210f0d662fb8" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-f8aa9b57-35d1-4d20-a95c-210f0d662fb8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot f8aa9b57-35d1-4d20-a95c-210f0d662fb8 of volume 81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f93070f-ae78-4fb9-9fbc-b53d427c2714]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663" returned: 0 in 0.400s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663 Nov 05 22:34:53 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 Nov 05 22:34:53 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:53 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 1073741824" returned: 0 in 0.480s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:53 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:53 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 Nov 05 22:34:53 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:54 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146.0d246834-0bc0-4f53-866e-46331fa7c663" returned: 0 in 0.301s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-0d246834-0bc0-4f53-866e-46331fa7c663" released by "_delete_snapshot" :: held 1.768s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" released by "delete_snapshot" :: held 1.792s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:54 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8" returned: 0 in 0.421s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cc87c8-80ba-48c6-b9a1-f62afa8e4d87]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:54 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12317bc-5bc7-4571-ac00-e5e937d4632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2eac64-2ab1-4786-838f-25aff7dd2b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Created reservations ['28fe0c6a-2032-407c-945d-7461f18b5aaa', 'f7e4b1ef-8822-413a-a282-e734ac065244', '901dfa1f-b0f2-44f0-abf9-86eead3248d7', 'a23ab533-3576-41d4-8261-2b3209976eb0'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:54 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Volume volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 (7a0bb69f-087a-446f-b7ca-3bbee1e99374): created successfully Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2eac64-2ab1-4786-838f-25aff7dd2b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Flow 'volume_create_manager' (32c2aa27-0c7c-4b8f-96f3-a34f34ae98eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f79f19e5-1809-4bef-b548-9d9f674d6ae8 tempest-ProjectReaderTests-2127386985 None] Created volume successfully. Nov 05 22:34:54 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd Nov 05 22:34:54 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:54 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Delete snapshot completed successfully. Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-61f589e5-21a8-45f3-838a-d9f6ea5946dc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-0d246834-0bc0-4f53-866e-46331fa7c663-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-3f6e16fa-5cc1-4477-89f8-d5c7be67a146-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-3f6e16fa-5cc1-4477-89f8-d5c7be67a146-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-quobyte-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" acquired by "delete_volume" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:54 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd" returned: 0 in 0.428s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5f3994-b512-4fde-bddd-ccc21de441e4]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:54 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 Nov 05 22:34:54 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:54 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 Nov 05 22:34:54 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:54 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8" returned: 0 in 0.384s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:54 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8 Nov 05 22:34:54 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:54 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" returned: 0 in 0.412s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:54 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:55 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146 Nov 05 22:34:55 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:55 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd.f8aa9b57-35d1-4d20-a95c-210f0d662fb8" returned: 0 in 0.258s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-f8aa9b57-35d1-4d20-a95c-210f0d662fb8" released by "_delete_snapshot" :: held 1.605s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-81e07bd1-b51e-496e-898b-2e85cd5c42cd" released by "delete_snapshot" :: held 1.633s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:55 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" returned: 0 in 0.283s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-3f6e16fa-5cc1-4477-89f8-d5c7be67a146" released by "delete_volume" :: held 0.790s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Creating offline snapshot 86cb2060-3437-4920-b09b-1376435b90d2 of volume 7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[36193bbb-3d7d-4a18-a766-345278d7af6f]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Created reservations ['cef8e9a1-8b6b-4eb6-97ce-916b3dff955e', '25ce732a-2d80-47cd-aab6-fe179d9a8e70', '74d18c38-d25b-440d-aaac-7c6f30d5d858', 'b4632086-71f0-4d03-a164-4759bd8040a0'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Created reservations ['de4e4366-8a9a-4d34-a3da-3d78066d4b4c', 'ddadf5e5-5876-4001-bca4-b2a32a4ae906', 'fdba1569-289a-4f3e-aba8-3c551f2a46c0', 'bb28c4b9-4582-4e75-aed4-51509dc78ceb'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-79a33263-2432-4d1e-a67b-54b21c3b32a5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-f8aa9b57-35d1-4d20-a95c-210f0d662fb8-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:55 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 Nov 05 22:34:55 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:55 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:55 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-ca69190e-e33d-453d-b133-b55f554d6198-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-ca69190e-e33d-453d-b133-b55f554d6198-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "cinder-quobyte-ca69190e-e33d-453d-b133-b55f554d6198" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-ca69190e-e33d-453d-b133-b55f554d6198" acquired by "delete_volume" :: waited 0.036s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecafc66-09a8-48f9-8766-b785eff1af97]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-81e07bd1-b51e-496e-898b-2e85cd5c42cd-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:55 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.302s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:55 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:55 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Deleted volume successfully. Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374" returned: 0 in 0.450s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Lock "cinder-81e07bd1-b51e-496e-898b-2e85cd5c42cd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:55 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 1G Nov 05 22:34:55 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-54423f33-6d46-4514-a55a-5cbf8eb43ccc tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-3f6e16fa-5cc1-4477-89f8-d5c7be67a146-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-81e07bd1-b51e-496e-898b-2e85cd5c42cd" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-81e07bd1-b51e-496e-898b-2e85cd5c42cd" acquired by "delete_volume" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:55 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 Nov 05 22:34:55 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe2eca6-1755-4e9d-ba08-6eab1256d608]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:55 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd Nov 05 22:34:56 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198" returned: 0 in 0.430s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198 Nov 05 22:34:56 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 1G" returned: 0 in 0.449s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 Nov 05 22:34:56 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd" returned: 0 in 0.455s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd Nov 05 22:34:56 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-ca69190e-e33d-453d-b133-b55f554d6198" returned: 0 in 0.309s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-quobyte-ca69190e-e33d-453d-b133-b55f554d6198" released by "delete_volume" :: held 0.806s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:56 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Created reservations ['45150865-657c-4c2a-b579-3b9aef65aa2f', 'f04348dd-bf80-45bf-8973-32a2ff8893be', '2f67520d-f40b-4938-84f0-494e5fe4dcef', '38353473-01f6-4cb1-867e-dc79a9d9b246'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 is being set with open permissions: ugo+rw Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 Nov 05 22:34:56 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-81e07bd1-b51e-496e-898b-2e85cd5c42cd" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-81e07bd1-b51e-496e-898b-2e85cd5c42cd" released by "delete_volume" :: held 0.827s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:56 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:56 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Created reservations ['88b6d459-c100-4dc7-ba35-f9e1cac39fc9', '6437f316-31ff-4d48-ada4-66dcf4cbf95e', 'e9d49e5a-c2bc-4913-a2ab-af5586515287', '5aaf3c3b-4d4f-4ba1-bfcb-94b063c62ffe'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:56 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2" returned: 0 in 0.330s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:56 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:34:56 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:56 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:57 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.info Nov 05 22:34:57 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:57 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.342s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Deleted volume successfully. Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-d5d0fd48-4c04-42f9-abef-02b6989e71c3 tempest-SnapshotDependencyTests-1863963495 None] Lock "cinder-ca69190e-e33d-453d-b133-b55f554d6198-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:57 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.316s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:34:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9098fb1a-0a78-4dfd-b39f-67d67ceb0684 tempest-ProjectMemberTests-533561658 None] Lock "cinder-81e07bd1-b51e-496e-898b-2e85cd5c42cd-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:34:57 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.info" returned: 0 in 0.353s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:57 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.info is being set with open permissions: ugo+rw Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:57 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.info Nov 05 22:34:57 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:34:57 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (5b45036a-4a92-4ac5-b110-8d814d89dcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1d0c77-07cf-456e-8f73-b9f7ecb0d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.info" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1d0c77-07cf-456e-8f73-b9f7ecb0d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832969721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c828096f-32c2-4b72-aa81-44617db0237d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:58Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aef479d-c13d-4f5e-b762-3077795cabcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aef479d-c13d-4f5e-b762-3077795cabcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563444b1-17ac-477d-bfa7-e3f5d1abb23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563444b1-17ac-477d-bfa7-e3f5d1abb23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c828096f-32c2-4b72-aa81-44617db0237d', 'volume_name': 'volume-c828096f-32c2-4b72-aa81-44617db0237d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaa00a7-aa21-47aa-b734-14f455852982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaa00a7-aa21-47aa-b734-14f455852982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04a300c-b21e-41b7-bb88-f65646f450df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:57 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Volume c828096f-32c2-4b72-aa81-44617db0237d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c828096f-32c2-4b72-aa81-44617db0237d', 'volume_size': 1} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832969721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c828096f-32c2-4b72-aa81-44617db0237d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:34:58Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Creating volume c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:34:57 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:34:57 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:57 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-d5849f9e-1346-4b98-9e0a-3927d51aef68 tempest-ProjectReaderTests-2127386985 None] Create snapshot completed successfully Nov 05 22:34:57 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d 1073741824 Nov 05 22:34:57 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:58 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d 1073741824" returned: 0 in 0.479s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:58 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d Nov 05 22:34:58 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:58 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-86cb2060-3437-4920-b09b-1376435b90d2-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d" returned: 0 in 0.299s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-86cb2060-3437-4920-b09b-1376435b90d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-7a0bb69f-087a-446f-b7ca-3bbee1e99374" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04a300c-b21e-41b7-bb88-f65646f450df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c828096f-32c2-4b72-aa81-44617db0237d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f5ceb5-f574-49f9-a263-e405da358287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-7a0bb69f-087a-446f-b7ca-3bbee1e99374" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-86cb2060-3437-4920-b09b-1376435b90d2" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:34:58 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Volume volume-c828096f-32c2-4b72-aa81-44617db0237d (c828096f-32c2-4b72-aa81-44617db0237d): created successfully Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f5ceb5-f574-49f9-a263-e405da358287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (5b45036a-4a92-4ac5-b110-8d814d89dcba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-86cb2060-3437-4920-b09b-1376435b90d2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Deleting offline snapshot 86cb2060-3437-4920-b09b-1376435b90d2 of volume 7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] snapshot_file for this snap is: volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:34:58 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-08bc8ec7-3ada-45f4-942a-27552d5eee07 tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e954bb-530b-47eb-b100-3efa8b8d9c08]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:58 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:58 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 Nov 05 22:34:58 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:59 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2" returned: 0 in 0.367s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f99784-24b4-4112-ba8d-43b0c98815f0]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:59 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 Nov 05 22:34:59 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:59 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374" returned: 0 in 0.383s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:59 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 Nov 05 22:34:59 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:59 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2" returned: 0 in 0.370s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:34:59 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2 Nov 05 22:34:59 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Creating offline snapshot 19e72801-9ddf-48c9-bba7-c8e697ef4318 of volume c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f99b99-8536-426d-8e50-bedc18dd5e83]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:34:59 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:00 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d Nov 05 22:35:00 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:00 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374.86cb2060-3437-4920-b09b-1376435b90d2" returned: 0 in 0.253s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-86cb2060-3437-4920-b09b-1376435b90d2" released by "_delete_snapshot" :: held 1.487s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-7a0bb69f-087a-446f-b7ca-3bbee1e99374" released by "delete_snapshot" :: held 1.524s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Created reservations ['e3df58e7-9a44-47e7-8a33-d602d1b38f98', '58a29027-a9f0-46f5-87a1-1244710be39c', 'a8d62dab-cd08-4b63-b48a-35fe0a45d8bf', 'd715bac3-58bb-4a18-9186-17892000e39b'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:00 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Delete snapshot completed successfully. Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-4bc303a0-c155-4833-acbe-72b0abe2e503 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-86cb2060-3437-4920-b09b-1376435b90d2-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:00 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d" returned: 0 in 0.395s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:00 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 1G Nov 05 22:35:00 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-7a0bb69f-087a-446f-b7ca-3bbee1e99374-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-7a0bb69f-087a-446f-b7ca-3bbee1e99374-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "cinder-quobyte-7a0bb69f-087a-446f-b7ca-3bbee1e99374" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-7a0bb69f-087a-446f-b7ca-3bbee1e99374" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:00 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 1G" returned: 0 in 0.533s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c828096f-32c2-4b72-aa81-44617db0237d -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c7d939-ee96-4c5f-acef-837093db52ba]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:00 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:00 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c828096f-32c2-4b72-aa81-44617db0237d -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 Nov 05 22:35:00 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:01 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 Nov 05 22:35:01 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:01 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c828096f-32c2-4b72-aa81-44617db0237d -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318" returned: 0 in 0.339s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:01 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 is being set with open permissions: ugo+rw Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:01 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 Nov 05 22:35:01 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:01 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374" returned: 0 in 0.440s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:01 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374 Nov 05 22:35:01 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:01 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318" returned: 0 in 0.360s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:01 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.info Nov 05 22:35:01 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:01 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-7a0bb69f-087a-446f-b7ca-3bbee1e99374" returned: 0 in 0.344s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-quobyte-7a0bb69f-087a-446f-b7ca-3bbee1e99374" released by "delete_volume" :: held 0.875s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Created reservations ['d9167b53-67e4-4960-8111-e61926be8447', '2405f92a-a672-47f2-848f-b5e7b9b691fc', '6ccbc0ee-9925-49af-b47d-1e83ca66b71c', 'ba64ecaa-b401-4728-9801-056b12feee16'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:01 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.info" returned: 0 in 0.294s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:01 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.info is being set with open permissions: ugo+rw Nov 05 22:35:01 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:01 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:35:01 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:01 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.info Nov 05 22:35:01 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:02 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.297s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:02 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Deleted volume successfully. Nov 05 22:35:02 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=223,cinder:INSERT=74,cinder:UPDATE=258,cinder:DELETE=23 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:35:02 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-9af1af0d-7456-424c-a598-6b910d866d38 tempest-ProjectReaderTests-2127386985 None] Lock "cinder-7a0bb69f-087a-446f-b7ca-3bbee1e99374-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:02 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.info" returned: 0 in 0.364s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:02 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:02 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:DELETE=22,cinder:SELECT=183,cinder:UPDATE=275,cinder:INSERT=69 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:35:02 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-bd9e01dc-e629-4bc5-9feb-5db0e619ee01 tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-19e72801-9ddf-48c9-bba7-c8e697ef4318-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-19e72801-9ddf-48c9-bba7-c8e697ef4318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-c828096f-32c2-4b72-aa81-44617db0237d" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-c828096f-32c2-4b72-aa81-44617db0237d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-19e72801-9ddf-48c9-bba7-c8e697ef4318" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-19e72801-9ddf-48c9-bba7-c8e697ef4318" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot 19e72801-9ddf-48c9-bba7-c8e697ef4318 of volume c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f67b35-66f8-4c1e-96ae-91c71f436871]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:03 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 Nov 05 22:35:03 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:03 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318" returned: 0 in 0.422s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c828096f-32c2-4b72-aa81-44617db0237d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d8b29-55b4-42da-802b-b8f8b570b54b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:03 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:03 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d Nov 05 22:35:03 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:04 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d" returned: 0 in 0.420s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:04 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 Nov 05 22:35:04 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:04 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318" returned: 0 in 0.416s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:04 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318 Nov 05 22:35:04 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:04 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d.19e72801-9ddf-48c9-bba7-c8e697ef4318" returned: 0 in 0.265s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-19e72801-9ddf-48c9-bba7-c8e697ef4318" released by "_delete_snapshot" :: held 1.644s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-c828096f-32c2-4b72-aa81-44617db0237d" released by "delete_snapshot" :: held 1.666s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Created reservations ['92dbb66f-b942-4dbe-8fd3-ee488c394545', 'bd49e5fd-6206-4f2c-9a2d-7ee3b50d420f', 'de9b589d-0b47-4bae-8681-09c34e0e3f19', '5414d560-e300-43b2-b4c6-c356884b9c96'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:04 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:35:04 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-63773ce5-8a01-4405-a9c7-1c4d5b048e50 tempest-ProjectMemberTests-533561658 None] Lock "cinder-19e72801-9ddf-48c9-bba7-c8e697ef4318-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-c828096f-32c2-4b72-aa81-44617db0237d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Lock "cinder-c828096f-32c2-4b72-aa81-44617db0237d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-c828096f-32c2-4b72-aa81-44617db0237d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-c828096f-32c2-4b72-aa81-44617db0237d" acquired by "delete_volume" :: waited 0.040s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8860d3ed-48cd-449d-968f-8ed161e70dcd]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:05 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d Nov 05 22:35:05 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:05 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d" returned: 0 in 0.396s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:05 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:05 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d Nov 05 22:35:05 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:06 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-c828096f-32c2-4b72-aa81-44617db0237d" returned: 0 in 0.294s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-c828096f-32c2-4b72-aa81-44617db0237d" released by "delete_volume" :: held 0.828s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Created reservations ['569f54a3-3bc8-4bf7-a658-14266f5e1998', 'c11a4e96-0e4e-4734-86f0-fbfbcbd15b13', 'd02128cb-d65c-4047-9331-8d4938f6113b', '4f9370bc-06df-4353-b53f-5a50d9278822'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:06 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:35:06 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:06 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.275s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:06 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:35:06 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-e2583f53-7b6c-4f76-acb0-b67f714f4b85 tempest-ProjectMemberTests-533561658 None] Lock "cinder-c828096f-32c2-4b72-aa81-44617db0237d-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (105b62ec-f2ac-4007-87e7-cfcb0b750703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4671dba5-6896-494a-a4cd-a58d55861e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4671dba5-6896-494a-a4cd-a58d55861e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888384075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d59b7a-1e75-4f3f-ad28-231c427bf159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:07Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d2cece-e38f-444b-9418-eaf5a2ee0733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d2cece-e38f-444b-9418-eaf5a2ee0733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7a20f0-e027-42d2-83a1-171cebba62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7a20f0-e027-42d2-83a1-171cebba62f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d59b7a-1e75-4f3f-ad28-231c427bf159', 'volume_name': 'volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4798528e-c25d-49aa-9b41-b19d39996928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4798528e-c25d-49aa-9b41-b19d39996928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd25e73c-9af3-497d-b697-ce7af8059ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:07 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Volume f0d59b7a-1e75-4f3f-ad28-231c427bf159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159', 'volume_size': 1} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888384075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d59b7a-1e75-4f3f-ad28-231c427bf159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:07Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Creating volume f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:07 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:07 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 1073741824 Nov 05 22:35:07 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:07 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 1073741824" returned: 0 in 0.506s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:07 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:07 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 Nov 05 22:35:07 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:08 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159" returned: 0 in 0.289s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:08 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:08 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd25e73c-9af3-497d-b697-ce7af8059ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3871388-ced7-44e5-9f7d-cbbae3092eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:08 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Volume volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 (f0d59b7a-1e75-4f3f-ad28-231c427bf159): created successfully Nov 05 22:35:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3871388-ced7-44e5-9f7d-cbbae3092eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:08 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (105b62ec-f2ac-4007-87e7-cfcb0b750703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:08 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1e1c92b7-2a5d-4caf-9b7b-cd22ae5a35f0 tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:35:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:09 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Creating offline snapshot 6e0f800c-8d23-43b5-a298-3ac48387ae60 of volume f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:35:09 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff53a98e-9f98-47ce-b7c4-35002097bc42]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:09 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 Nov 05 22:35:09 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:09 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159" returned: 0 in 0.365s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:09 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:09 devstack sudo[108667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 1G Nov 05 22:35:09 devstack sudo[108667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:10 devstack sudo[108667]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 1G" returned: 0 in 0.406s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:10 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 Nov 05 22:35:10 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:10 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60" returned: 0 in 0.309s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:10 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 is being set with open permissions: ugo+rw Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:10 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 Nov 05 22:35:10 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:10 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60" returned: 0 in 0.240s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:10 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.info Nov 05 22:35:10 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:10 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.info" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:10 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.info is being set with open permissions: ugo+rw Nov 05 22:35:10 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:10 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.info Nov 05 22:35:10 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:11 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.info" returned: 0 in 0.237s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:11 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-1650a436-cbef-43b1-a821-587355132def tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-6e0f800c-8d23-43b5-a298-3ac48387ae60-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Lock "cinder-6e0f800c-8d23-43b5-a298-3ac48387ae60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-f0d59b7a-1e75-4f3f-ad28-231c427bf159" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-f0d59b7a-1e75-4f3f-ad28-231c427bf159" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-6e0f800c-8d23-43b5-a298-3ac48387ae60" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-6e0f800c-8d23-43b5-a298-3ac48387ae60" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot 6e0f800c-8d23-43b5-a298-3ac48387ae60 of volume f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdbe181-0299-423f-bc73-b064a4ec5b51]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:11 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 Nov 05 22:35:11 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:11 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60" returned: 0 in 0.376s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[8955b273-4f08-4bc8-b8ef-9c611ddc5834]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:11 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:12 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 Nov 05 22:35:12 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:12 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159" returned: 0 in 0.405s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:12 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 Nov 05 22:35:12 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:12 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60" returned: 0 in 0.383s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:12 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:12 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60 Nov 05 22:35:12 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:13 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159.6e0f800c-8d23-43b5-a298-3ac48387ae60" returned: 0 in 0.267s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-6e0f800c-8d23-43b5-a298-3ac48387ae60" released by "_delete_snapshot" :: held 1.545s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-f0d59b7a-1e75-4f3f-ad28-231c427bf159" released by "delete_snapshot" :: held 1.568s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Created reservations ['15a927b4-2909-4d8c-9c7b-4ad3813f61d6', '8d8c85ca-a09f-4a05-9e8e-de5238bd0738', '78a8e321-85fb-4613-a084-c38054ffbe53', 'fa0c2c95-3cf4-4ee9-a975-99a9ed0e0836'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:13 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-3d792a15-4659-4f11-a16a-f282f786e438 tempest-ProjectMemberTests-533561658 None] Lock "cinder-6e0f800c-8d23-43b5-a298-3ac48387ae60-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-f0d59b7a-1e75-4f3f-ad28-231c427bf159-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Lock "cinder-f0d59b7a-1e75-4f3f-ad28-231c427bf159-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-f0d59b7a-1e75-4f3f-ad28-231c427bf159" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-f0d59b7a-1e75-4f3f-ad28-231c427bf159" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[941877b3-5141-4755-a8de-72fabf77f95b]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:13 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:13 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 Nov 05 22:35:13 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:14 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159" returned: 0 in 0.374s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:14 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159 Nov 05 22:35:14 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:14 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-f0d59b7a-1e75-4f3f-ad28-231c427bf159" returned: 0 in 0.257s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-f0d59b7a-1e75-4f3f-ad28-231c427bf159" released by "delete_volume" :: held 0.702s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Created reservations ['c3e04f6f-0cb7-4f7b-adbc-9ec4c75cab28', 'a4cf1884-6dbc-4743-aa1c-8cf8eaae76c1', '6d8025ab-9337-46f0-8837-1f9bda60a74c', '57208cc7-bb22-4c36-ae2c-8f4568f7f030'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:14 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:35:14 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:14 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.266s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:14 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:35:14 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-a9f0e458-f7e9-4b97-b287-ca5b83b977f2 tempest-ProjectMemberTests-533561658 None] Lock "cinder-f0d59b7a-1e75-4f3f-ad28-231c427bf159-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (e74f3ad2-1071-4de9-807f-c9e5b65f32cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4d3f83-4deb-46ab-b3c1-b0bd9ece357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4d3f83-4deb-46ab-b3c1-b0bd9ece357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725908610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d46d39f-d143-465e-bbba-93fbc184f54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:15Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5551af-dc6a-4d05-9d5d-8ef4ee183039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5551af-dc6a-4d05-9d5d-8ef4ee183039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c6d41c-e7fc-4de2-a8a5-0ae60dc721bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c6d41c-e7fc-4de2-a8a5-0ae60dc721bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d46d39f-d143-465e-bbba-93fbc184f54d', 'volume_name': 'volume-6d46d39f-d143-465e-bbba-93fbc184f54d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4140199a-e06e-4edb-8b2d-292f767c0362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4140199a-e06e-4edb-8b2d-292f767c0362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2a81b0-295e-4bd2-be26-d9da18547d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:15 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Volume 6d46d39f-d143-465e-bbba-93fbc184f54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d46d39f-d143-465e-bbba-93fbc184f54d', 'volume_size': 1} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1725908610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d46d39f-d143-465e-bbba-93fbc184f54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21de18ad0ba14a13b7d51ae5863b8a54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:15Z,use_quota=True,user_id='cf2550dc37284094af8830064b39bf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Creating volume 6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:15 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:15 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d 1073741824 Nov 05 22:35:15 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:15 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d 1073741824" returned: 0 in 0.453s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:15 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:15 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d Nov 05 22:35:15 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:16 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d" returned: 0 in 0.248s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:16 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:16 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2a81b0-295e-4bd2-be26-d9da18547d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d46d39f-d143-465e-bbba-93fbc184f54d', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9589c76-4a4d-4f84-9b50-9603f2cc7965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:16 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Volume volume-6d46d39f-d143-465e-bbba-93fbc184f54d (6d46d39f-d143-465e-bbba-93fbc184f54d): created successfully Nov 05 22:35:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9589c76-4a4d-4f84-9b50-9603f2cc7965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:16 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Flow 'volume_create_manager' (e74f3ad2-1071-4de9-807f-c9e5b65f32cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:16 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-66c10410-5665-4e7a-983d-2c6aedc68914 tempest-ProjectMemberTests-533561658 None] Created volume successfully. Nov 05 22:35:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:17 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Creating offline snapshot 835ed526-37c2-47c4-9cbf-1c3f87408b70 of volume 6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 22:35:17 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[335ffe3f-f6fc-417e-9193-c907ea783ca5]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:17 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d Nov 05 22:35:17 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:17 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:17 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 1G {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:17 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 1G Nov 05 22:35:17 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:18 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 1G" returned: 0 in 0.380s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d46d39f-d143-465e-bbba-93fbc184f54d -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:18 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d46d39f-d143-465e-bbba-93fbc184f54d -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 Nov 05 22:35:18 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:18 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d46d39f-d143-465e-bbba-93fbc184f54d -F qcow2 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70" returned: 0 in 0.302s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:18 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 is being set with open permissions: ugo+rw Nov 05 22:35:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:18 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 Nov 05 22:35:18 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:18 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70" returned: 0 in 0.240s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:18 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:18 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.info Nov 05 22:35:18 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:19 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.info" returned: 0 in 0.244s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:19 devstack cinder-volume[87085]: WARNING cinder.volume.drivers.remotefs [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.info is being set with open permissions: ugo+rw Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.info {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:19 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.info Nov 05 22:35:19 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:19 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.info" returned: 0 in 0.237s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:19 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-ac089fd0-3f3f-4711-a4ea-6c3eb386c26f tempest-ProjectMemberTests-533561658 None] Create snapshot completed successfully Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-835ed526-37c2-47c4-9cbf-1c3f87408b70-delete_snapshot" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Lock "cinder-835ed526-37c2-47c4-9cbf-1c3f87408b70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-6d46d39f-d143-465e-bbba-93fbc184f54d" by "delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-6d46d39f-d143-465e-bbba-93fbc184f54d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-835ed526-37c2-47c4-9cbf-1c3f87408b70" by "_delete_snapshot" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-835ed526-37c2-47c4-9cbf-1c3f87408b70" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Deleting offline snapshot 835ed526-37c2-47c4-9cbf-1c3f87408b70 of volume 6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] snapshot_file for this snap is: volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 {{(pid=87085) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2eea30-2785-48c0-b8a8-3b6bc6b8a90d]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:19 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:19 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 Nov 05 22:35:19 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:20 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d46d39f-d143-465e-bbba-93fbc184f54d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87085) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff964264-40c4-4a65-a1fc-88eea7c57425]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:20 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d Nov 05 22:35:20 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:20 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d" returned: 0 in 0.355s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:20 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 Nov 05 22:35:20 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:20 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70" returned: 0 in 0.327s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:20 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:20 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70 Nov 05 22:35:20 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:21 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d.835ed526-37c2-47c4-9cbf-1c3f87408b70" returned: 0 in 0.243s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-835ed526-37c2-47c4-9cbf-1c3f87408b70" released by "_delete_snapshot" :: held 1.369s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-6d46d39f-d143-465e-bbba-93fbc184f54d" released by "delete_snapshot" :: held 1.393s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Created reservations ['439585d3-f8a6-4609-83a4-8baf3ca265c0', '77bed654-7868-4115-868b-f5590c722b0f', 'bdbe4404-2577-44f5-b2a4-eb6c841e7aa6', '5b2d1c94-bb06-4152-9a34-07336e1347cc'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:21 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Delete snapshot completed successfully. Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f75a78a0-7e75-47d6-9a4a-b8d8380ad215 tempest-ProjectMemberTests-533561658 None] Lock "cinder-835ed526-37c2-47c4-9cbf-1c3f87408b70-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-6d46d39f-d143-465e-bbba-93fbc184f54d-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-6d46d39f-d143-465e-bbba-93fbc184f54d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:21 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Acquiring lock "cinder-quobyte-6d46d39f-d143-465e-bbba-93fbc184f54d" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-6d46d39f-d143-465e-bbba-93fbc184f54d" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04916d4-4c84-4708-8278-41b28f2aeb25]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:22 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d Nov 05 22:35:22 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:22 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d" returned: 0 in 0.362s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:22 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d Nov 05 22:35:22 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:22 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-6d46d39f-d143-465e-bbba-93fbc184f54d" returned: 0 in 0.249s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-quobyte-6d46d39f-d143-465e-bbba-93fbc184f54d" released by "delete_volume" :: held 0.670s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Created reservations ['03794514-e842-46d1-9ea6-9bdcc9847c14', '077dab6f-9516-4ba0-8841-6e10e4c42ef0', '1c4d4e80-a7bf-4e64-87cc-13185b746ffd', 'c9b70100-6b41-45a0-b0c1-f605de845ee3'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:22 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:22 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:35:22 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:23 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:23 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.239s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:23 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:23 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Deleted volume successfully. Nov 05 22:35:23 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-67ec855c-b825-4cba-af31-223d198da9e5 tempest-ProjectMemberTests-533561658 None] Lock "cinder-6d46d39f-d143-465e-bbba-93fbc184f54d-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:32 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:UPDATE=52,cinder:DELETE=5,cinder:SELECT=33,cinder:INSERT=14 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:35:33 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Flow 'volume_create_manager' (60a4b734-80ba-4a46-bb5d-7736963283f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37cf8e9-120b-404a-93be-fec2cc330566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37cf8e9-120b-404a-93be-fec2cc330566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128657308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2968d071-7e00-4f10-969a-d55c587346cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962ca7bb31ff4b87bfe7abc2d9b5acd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:35Z,use_quota=True,user_id='9189919c61f14eb2a76b0a7710d299f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff187950-2d79-4c20-91ff-93dba00d1ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff187950-2d79-4c20-91ff-93dba00d1ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eb08d4-f920-46f5-9ff5-0603ea629772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76eb08d4-f920-46f5-9ff5-0603ea629772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2968d071-7e00-4f10-969a-d55c587346cf', 'volume_name': 'volume-2968d071-7e00-4f10-969a-d55c587346cf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe99729-a60e-4818-9e7e-e132f319c9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe99729-a60e-4818-9e7e-e132f319c9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7d9d7-ad7a-4be9-958d-9a92e922bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:35 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Volume 2968d071-7e00-4f10-969a-d55c587346cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2968d071-7e00-4f10-969a-d55c587346cf', 'volume_size': 1} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128657308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2968d071-7e00-4f10-969a-d55c587346cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962ca7bb31ff4b87bfe7abc2d9b5acd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:35Z,use_quota=True,user_id='9189919c61f14eb2a76b0a7710d299f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Creating volume 2968d071-7e00-4f10-969a-d55c587346cf {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:35 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:35 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf 1073741824 Nov 05 22:35:35 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:35 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf 1073741824" returned: 0 in 0.409s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:35 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:35 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf Nov 05 22:35:35 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:36 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf" returned: 0 in 0.240s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d7d9d7-ad7a-4be9-958d-9a92e922bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2968d071-7e00-4f10-969a-d55c587346cf', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43fc0a7-6fec-47a9-ad0c-be3e5e4d4f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:36 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Volume volume-2968d071-7e00-4f10-969a-d55c587346cf (2968d071-7e00-4f10-969a-d55c587346cf): created successfully Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43fc0a7-6fec-47a9-ad0c-be3e5e4d4f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Flow 'volume_create_manager' (60a4b734-80ba-4a46-bb5d-7736963283f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:36 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-12f3f43f-8a4b-4343-9bd7-d19375a5cdc6 tempest-ProjectReaderTests-605682068 None] Created volume successfully. Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Acquiring lock "cinder-2968d071-7e00-4f10-969a-d55c587346cf-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Lock "cinder-2968d071-7e00-4f10-969a-d55c587346cf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Acquiring lock "cinder-quobyte-2968d071-7e00-4f10-969a-d55c587346cf" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Lock "cinder-quobyte-2968d071-7e00-4f10-969a-d55c587346cf" acquired by "delete_volume" :: waited 0.014s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9c2cfa-4bc5-4480-8606-324e705dfa84]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:36 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf Nov 05 22:35:36 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:36 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf" returned: 0 in 0.358s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:36 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:36 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf Nov 05 22:35:36 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:37 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-2968d071-7e00-4f10-969a-d55c587346cf" returned: 0 in 0.244s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Lock "cinder-quobyte-2968d071-7e00-4f10-969a-d55c587346cf" released by "delete_volume" :: held 0.644s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Created reservations ['1f4de8b9-1664-4b3b-bbdc-da5694c590f6', '27134be6-9dec-4a74-8cea-3b2877d4afa3', '04e274ee-8ae6-4feb-9167-3f549926f706', '646ecbf8-dcf9-4a74-8246-d8d688c23a15'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:37 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:35:37 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:37 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.240s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:37 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Deleted volume successfully. Nov 05 22:35:37 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-f352b12d-358e-4f28-880a-daca643e745f tempest-ProjectReaderTests-605682068 None] Lock "cinder-2968d071-7e00-4f10-969a-d55c587346cf-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87085) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Flow 'volume_create_manager' (5856b3c5-722b-4b7f-ad97-bce2f829bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71796600-54b5-4395-aa3a-7bb1aba4f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71796600-54b5-4395-aa3a-7bb1aba4f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34968437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389aa34c-2f21-4064-9c47-855fbcdd9e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962ca7bb31ff4b87bfe7abc2d9b5acd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:38Z,use_quota=True,user_id='9189919c61f14eb2a76b0a7710d299f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d066adf-8e85-4fea-bf4e-1458c0aa3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d066adf-8e85-4fea-bf4e-1458c0aa3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ade6981-8486-4c25-b00a-c41de1b22217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ade6981-8486-4c25-b00a-c41de1b22217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '389aa34c-2f21-4064-9c47-855fbcdd9e94', 'volume_name': 'volume-389aa34c-2f21-4064-9c47-855fbcdd9e94', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d01c52-0b5e-4564-9b94-d8ccc2065ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d01c52-0b5e-4564-9b94-d8ccc2065ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1defa13-5e10-4003-a310-a582729b1132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:38 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Volume 389aa34c-2f21-4064-9c47-855fbcdd9e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-389aa34c-2f21-4064-9c47-855fbcdd9e94', 'volume_size': 1} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T21:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34968437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389aa34c-2f21-4064-9c47-855fbcdd9e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962ca7bb31ff4b87bfe7abc2d9b5acd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T21:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T21:35:38Z,use_quota=True,user_id='9189919c61f14eb2a76b0a7710d299f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c458d8-c310-4c6f-8174-0743757c5ce8),volume_type_id=84c458d8-c310-4c6f-8174-0743757c5ce8)}" {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.remotefs [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Creating volume 389aa34c-2f21-4064-9c47-855fbcdd9e94 {{(pid=87085) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Selected osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 as target Quobyte volume. {{(pid=87085) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 22:35:38 devstack cinder-volume[87085]: INFO cinder.volume.drivers.remotefs [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] casted to osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140 Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 1073741824 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 1073741824 Nov 05 22:35:38 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 1073741824" returned: 0 in 0.419s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:38 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 Nov 05 22:35:38 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:38 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94" returned: 0 in 0.255s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'} {{(pid=87085) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1defa13-5e10-4003-a310-a582729b1132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389aa34c-2f21-4064-9c47-855fbcdd9e94', 'volume_size': 1}' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbe5a16-8c80-492d-8b06-65da3b5f0fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 22:35:38 devstack cinder-volume[87085]: INFO cinder.volume.flows.manager.create_volume [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Volume volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 (389aa34c-2f21-4064-9c47-855fbcdd9e94): created successfully Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbe5a16-8c80-492d-8b06-65da3b5f0fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87085) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 22:35:38 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Flow 'volume_create_manager' (5856b3c5-722b-4b7f-ad97-bce2f829bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87085) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 22:35:38 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-e8c76962-975f-4033-9b4d-993b0961f7ab tempest-ProjectReaderTests-605682068 None] Created volume successfully. Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Acquiring lock "cinder-389aa34c-2f21-4064-9c47-855fbcdd9e94-delete_volume" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Lock "cinder-389aa34c-2f21-4064-9c47-855fbcdd9e94-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Acquiring lock "cinder-quobyte-389aa34c-2f21-4064-9c47-855fbcdd9e94" by "delete_volume" {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Lock "cinder-quobyte-389aa34c-2f21-4064-9c47-855fbcdd9e94" acquired by "delete_volume" :: waited 0.019s {{(pid=87085) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo.privsep.daemon [-] privsep: reply[b069d5a7-9db8-42ed-9db1-f6215eb55510]: (4, 'qcow2') {{(pid=88570) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:39 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 Nov 05 22:35:39 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:39 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94" returned: 0 in 0.361s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:39 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94 Nov 05 22:35:39 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:39 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36/volume-389aa34c-2f21-4064-9c47-855fbcdd9e94" returned: 0 in 0.247s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Lock "cinder-quobyte-389aa34c-2f21-4064-9c47-855fbcdd9e94" released by "delete_volume" :: held 0.649s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.quota [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Created reservations ['5de7bc2a-8375-4c15-b971-c4ab09764146', '1ed3f8cf-9320-498c-9807-bc30f5cc6a6c', 'b1818081-a253-4bf1-9bbe-931ef56fed0a', '1ea998c9-d8b8-4ac4-8cc8-039f2829869a'] {{(pid=87085) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:39 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:39 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:35:39 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.244s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:40 devstack cinder-volume[87085]: INFO cinder.volume.manager [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Deleted volume successfully. Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG cinder.coordination [None req-eec7f249-3de0-4a34-a6cc-b31d0af277f6 tempest-ProjectReaderTests-605682068 None] Lock "cinder-389aa34c-2f21-4064-9c47-855fbcdd9e94-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87085) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140': None} {{(pid=87085) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG cinder.volume.drivers.quobyte [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0a055b66-97a3-42da-8233-06fb7ca05140'] {{(pid=87085) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.lockutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87085) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 22:35:40 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36 Nov 05 22:35:40 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 22:35:40 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_concurrency.processutils [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b69e96ae289e3b07a174b5c42427fc36" returned: 0 in 0.271s {{(pid=87085) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG cinder.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Notifying Schedulers of capabilities ... {{(pid=87085) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG oslo_service.periodic_task [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] Running periodic task VolumeManager._thread_info {{(pid=87085) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread count: 28 {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 22:35:40 devstack cinder-volume[87085]: DEBUG cinder.volume.manager [None req-01238e83-f949-42ca-9fdf-0f956677104c None None] thread info: [<_MainThread(MainThread, started 139078942023808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87085) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 22:35:50 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=14,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 22:35:50 devstack cinder-volume[87085]: DEBUG dbcounter [-] [87085] Writing DB stats cinder:SELECT=15,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87085) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}